Research Lead / Principal Scientist & Manager Post-training · Alignment · Reinforcement Learning Autodesk AI Lab: London · San Francisco · Toronto · Remote (us/ca/eu) -

Autodesk Autodesk · Enterprise · London, United Kingdom

Research Lead / Principal Scientist & Manager for Post-Training, Alignment, and Reinforcement Learning at Autodesk AI Lab. The role focuses on transforming foundation models into reliable, aligned, and useful systems for domain-specific workflows, leveraging unique Autodesk assets like physics simulation engines for reward signals. Responsibilities include research strategy, algorithm development, team leadership, and driving evaluation frameworks. The role emphasizes research with real-world product impact and publication at top-tier venues.

What you'd actually do

  1. Own post-training strategy for model development — from RLHF and preference optimization to agentic systems and long-horizon reasoning
  2. Design evaluation frameworks for long-horizon reasoning, tool use, agentic behavior, safety, and real-world workflow completion
  3. Manage, mentor, and grow a team of AI scientists
  4. Develop novel algorithms that improve model reliability, controllability, and alignment
  5. Make principled architectural decisions about when to address challenges at the pre-training, post-training, or system level

Skills

Required

  • Reinforcement learning for foundation models
  • Post-training methods (RLHF, RLAIF, DPO, PPO)
  • Leading or mentoring technical research teams
  • Model behavior intuition
  • Alignment challenges
  • Post-training trade-offs
  • Designing evaluation systems
  • Rigorous thinking about model readiness
  • Communicating complex technical trade-offs
  • PhD or equivalent depth of industry research experience in ML, RL, AI, or related field

Nice to have

  • Experience at a frontier model lab or advanced applied AI organization
  • Strong publication record at leading ML or AI venues
  • Background in alignment research, preference learning, or agentic AI
  • Experience deploying or supporting production AI systems
  • Familiarity with large-scale training infrastructure and compute trade-offs

What the JD emphasized

  • Deep hands-on expertise in reinforcement learning for foundation models, and fluency with post-training methods (RLHF, RLAIF, DPO, PPO, or adjacent approaches)
  • Proven experience leading or mentoring technical research teams
  • Strong intuition for model behavior, alignment challenges, and post-training trade-offs
  • Experience designing evaluation systems and thinking rigorously about what it means for a model to be ready

Other signals

  • foundation models
  • post-training
  • alignment
  • reinforcement learning
  • domain-specific workflows
  • reliability
  • controllability