Research Engineer, Production Model Post-training

Anthropic Anthropic · AI Frontier · New York, NY +2 · AI Research & Engineering

Research Engineer focused on post-training of large language models, including techniques like Constitutional AI and RLHF, to enhance model capabilities, alignment, and safety for production Claude models. Involves implementing, scaling, and optimizing these processes, conducting research for improvements, and developing evaluation tools.

What you'd actually do

  1. Implement and optimize post-training techniques at scale on frontier models
  2. Conduct research to develop and optimize post-training recipes that directly improve production model quality
  3. Design, build, and run robust, efficient pipelines for model fine-tuning and evaluation
  4. Develop tools to measure and improve model performance across various dimensions
  5. Collaborate with research teams to translate emerging techniques into production-ready implementations

Skills

Required

  • Python
  • deep learning frameworks
  • distributed computing
  • software engineering skills
  • building complex ML systems
  • large-scale distributed systems
  • high-performance computing
  • training, fine-tuning, or evaluating large language models
  • analyzing and debugging model training processes

Nice to have

  • LLMs
  • AI safety
  • responsible deployment

What the JD emphasized

  • proficiency in Python, deep learning frameworks, and distributed computing is required
  • experience with training, fine-tuning, or evaluating large language models
  • respond to incidents on short-notice, including on weekends

Other signals

  • train base models through the complete post-training stack
  • implementing, scaling, and improving post-training techniques like Constitutional AI, RLHF
  • directly impact the quality, safety, and capabilities of our production models