Research Engineer, Production Model Post-training, London

Anthropic Anthropic · AI Frontier · AI Research & Engineering

Research Engineer focused on post-training of production AI models, including techniques like Constitutional AI and RLHF. The role involves implementing, scaling, and optimizing these processes, conducting research to improve model quality, and developing pipelines for fine-tuning and evaluation. Requires strong software engineering skills, experience with large-scale distributed systems, and familiarity with training/fine-tuning/evaluating LLMs. The role directly impacts the quality, safety, and capabilities of production models.

What you'd actually do

  1. Implement and optimize post-training techniques at scale on frontier models
  2. Conduct research to develop and optimize post-training recipes that directly improve production model quality
  3. Design, build, and run robust, efficient pipelines for model fine-tuning and evaluation
  4. Develop tools to measure and improve model performance across various dimensions
  5. Collaborate with research teams to translate emerging techniques into production-ready implementations

Skills

Required

  • Python
  • deep learning frameworks
  • distributed computing
  • building complex ML systems
  • large-scale distributed systems
  • high-performance computing
  • training, fine-tuning, or evaluating large language models
  • analyzing and debugging model training processes

Nice to have

  • LLMs
  • AI safety and responsible deployment

What the JD emphasized

  • proficiency in Python
  • deep learning frameworks
  • distributed computing is required
  • experience with training, fine-tuning, or evaluating large language models
  • responding to incidents on short-notice, including on weekends

Other signals

  • train production models
  • post-training techniques
  • alignment methodologies
  • large-scale distributed systems
  • high-performance computing
  • training, fine-tuning, or evaluating large language models