Research Scientist - World Model

Luma AI Luma AI · AI Frontier · SF Bay Area, CA +2 · Remote · Research

Research Scientist focused on inventing and developing next-generation world model architectures for generative video, emphasizing controllability, physical consistency, and embodied reasoning. The role involves defining metrics, running scaling studies, and publishing/open-sourcing frontier research.

What you'd actually do

  1. Invent next-generation world model architectures — diffusion, transformer, autoregressive, or hybrid — with a particular focus on controllability and physical consistency.
  2. Develop controllability mechanisms that let an agent step into the world: action conditioning, view conditioning, long-horizon rollouts.
  3. Define and own the metrics: physical fidelity, long-horizon coherence, action-following, and downstream usefulness for policy training.
  4. Run scaling studies that tell us where compute, data, and architecture pay off.
  5. Publish at the frontier; contribute to the open-source release that is the long-term deliverable.

Skills

Required

  • PyTorch
  • large-scale training
  • generative modeling (video/3D/world)
  • self-supervised representation learning
  • model-based RL

Nice to have

  • world models
  • model-based RL
  • generative video
  • neural simulation
  • 4D scene representations
  • generative models for downstream embodied tasks
  • planning
  • control
  • evaluation
  • open-sourcing frontier models

What the JD emphasized

  • PhD or equivalent research record
  • research record the field knows (top-venue publications and/or widely-used open releases)

Other signals

  • world models
  • generative video
  • embodied reasoning
  • physical consistency
  • controllability