Research Scientist, World Modelling

Meta Meta · Big Tech · Menlo Park, CA

Research Scientist role focused on building world models for embodied agents, involving self-supervised learning from video, predictive models, model-based reinforcement learning, and model-predictive control. The role aims to advance research across the stack, including data curation, training large-scale models, and designing benchmarks, with a focus on influencing research communities through publications and open-source code.

What you'd actually do

  1. Lead, collaborate, and execute on research that pushes forward the state of the art in world modelling and artificial intelligence
  2. Perform research that enables learning the semantics of data across modalities including images, video, text, and audio
  3. Work towards long-term research goals while identifying immediate milestones
  4. Develop and evaluate novel architectures and training methods for learning predictive models of visual, physical, or multimodal environments
  5. Explore applications of world models to planning, prediction, control, and decision-making for embodied agents

Skills

Required

  • PhD degree in AI, computer science, data science, robotics, or related technical fields
  • Experience coding software and executing complex experiments
  • Experience with Python and PyTorch
  • Experience solving complex problems and comparing alternative solutions, tradeoffs, and different perspectives to determine a path forward
  • Experience with self-supervised learning from video, predictive models, model-based reinforcement learning, or model-predictive control
  • Experience building systems based on machine learning or deep learning methods
  • Experience manipulating and analyzing complex, large-scale, high-dimensionality data from varying sources
  • Experience collaborating in a team environment on research projects

Nice to have

  • Experience with world model-based planning and control
  • Experience with multimodal learning
  • Experience with data curation for large-scale models
  • Experience designing robust benchmarks

What the JD emphasized

  • First-authored publications at peer-reviewed conferences such as ICML, NeurIPS, ICLR, CVPR, ICCV, CoRL, RSS, or ICRA, or similar
  • Track record of achieving significant results as demonstrated by grants, fellowships, patents, or publications at leading conferences in Machine Learning (NeurIPS, ICML, ICLR), Robotics (ICRA, IROS, RSS, CoRL), or Computer Vision (CVPR, ICCV, ECCV)

Other signals

  • world models
  • embodied agents
  • reinforcement learning
  • predictive models