Principal AI Research Scientist Post-training · Alignment · Reinforcement Learning Autodesk AI Lab: London · San Francisco · Toronto · Remote (us/ca/eu

Autodesk Autodesk · Enterprise · San Francisco, CA +7 · Remote

Autodesk is seeking a Principal AI Research Scientist to focus on post-training and alignment research for foundation models, leveraging unique domain-grounded verifiers and physics simulation engines. The role involves developing novel algorithms, designing experiments, building scalable workflows, and contributing to publications. Experience with RLHF, agentic systems, long-horizon reasoning, and evaluation frameworks is critical. The position offers a direct path from research to product impact within Autodesk's diverse domains.

What you'd actually do

  1. Post-training for model development — from RLHF and preference optimization to agentic systems and long-horizon reasoning
  2. Develop novel algorithms that improve model reliability, controllability, and alignment
  3. Make principled architectural decisions about when to address challenges at the pre-training, post-training, or system level
  4. Design and run experiments that shape model behavior, robustness, and reasoning quality
  5. Partner with infrastructure teams to build scalable, reproducible post-training workflows

Skills

Required

  • Reinforcement learning for foundation models
  • Post-training methods (RLHF, RLAIF, DPO, PPO)
  • Leading or mentoring technical research teams
  • Designing evaluation systems
  • Communicating complex technical trade-offs
  • PhD or equivalent industry research experience in ML, RL, AI
  • Experience at a frontier model lab or advanced applied AI organization
  • Strong publication record at leading ML or AI venues
  • Alignment research, preference learning, or agentic AI background
  • Deploying or supporting production AI systems
  • Familiarity with large-scale training infrastructure and compute trade-offs

Nice to have

  • Physics simulation engines
  • CAD kernels
  • Computational design tools
  • Domain-grounded verifiers as reward signals

What the JD emphasized

  • Deep hands-on expertise in reinforcement learning for foundation models, and fluency with post-training methods (RLHF, RLAIF, DPO, PPO, or adjacent approaches)
  • Proven experience leading or mentoring technical research teams
  • Experience designing evaluation systems and thinking rigorously about what it means for a model to be ready
  • A strong publication record at leading ML or AI venues
  • Background in alignment research, preference learning, or agentic AI

Other signals

  • Post-training and alignment research
  • Reinforcement learning for foundation models
  • Agentic systems and long-horizon reasoning
  • Scalable, reproducible post-training workflows
  • Publication record at leading ML or AI venues