Research Engineer, Human Understanding, Deepmind

Google Google · Big Tech · Mountain View, CA +2

Research Engineer at Google DeepMind focused on developing and implementing novel multimodal models for human understanding across visual, audio, and textual data. The role involves conducting experimental research cycles, taking ownership of technical projects, contributing to research infrastructure, and tuning vision-language and foundation models for specific tasks like deepfake detection and privacy-preserving matching. Experience with Generative AI, multimodal learning, and a publication track record are preferred.

What you'd actually do

  1. Research and implement novel models and other multimodal techniques for a more holistic understanding of human likeness across visual, audio, and textual data.
  2. Conduct experimental research cycles from hypothesis to deployment, focusing on areas like scalable deepfake detection, privacy-preserving matching, and consistent human likeness generation.
  3. Take ownership of substantial technical projects within human likeness modeling (HLM), from ideation and design to implementation and evaluation, often involving cross-functional collaboration.
  4. Inform and contribute to the development of scalable and efficient research infrastructure for HLM models and datasets.
  5. Design and execute strategies for tuning and adapting vision-language models (VLMs) and other foundation models for specific HLM tasks, such as improved explainability and nuanced likeness measurement.

Skills

Required

  • Python
  • JAX
  • Flax
  • Gemax
  • Machine Learning
  • Deep Learning
  • Experimental Design
  • Implementation
  • Analysis
  • Audio/Speech-Visual Models
  • Vision Language Models

Nice to have

  • Generative AI
  • Multimodal Learning
  • Reinforcement Learning
  • Alignment Methods
  • Privacy-Preserving Machine Learning
  • Responsible AI Practices
  • Publications in AI/ML conferences

What the JD emphasized

  • 5 years of experience developing machine learning models
  • Experience working with and tuning vision language models
  • Experience programming in Python and with deep learning frameworks (e.g., JAX, Flax, or Gemax)
  • Experience conducting research and development, including experimental design, implementation, and analysis.
  • A track record of publications in AI/ML conferences (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV)

Other signals

  • novel models
  • multimodal techniques
  • human likeness
  • deepfake detection
  • privacy-preserving matching
  • human likeness generation
  • vision-language models
  • foundation models
  • explainability
  • nuanced likeness measurement