Software Engineer, RL Training Infra

OpenAI OpenAI · AI Frontier · San Francisco, CA · Research

Software Engineer focused on the infrastructure and engineering challenges of large-scale reinforcement learning training for frontier AI agents, including scaling, orchestration, inference, and reliability, with a secondary focus on agentic capabilities like multi-agent systems and memory.

What you'd actually do

  1. Keep large-scale RL training runs moving by jumping into the most urgent engineering and infrastructure problems.
  2. Debug issues across training systems, inference, orchestration, scaling, and distributed infrastructure.
  3. Solve hard technical problems at the boundary between research and engineering: scaling experiments, improving training reliability, debugging distributed systems, reducing latency and cost, and making new capabilities robust under real workloads.
  4. Improve reliability and efficiency for RL training runs.
  5. Help researchers who are developing infra-heavy integrations, such as multi-agent capabilities or memory.

Skills

Required

  • strong generalist engineer
  • ML infrastructure
  • RL
  • inference
  • scaling
  • training systems
  • orchestration
  • debugging
  • distributed systems
  • high ownership
  • communication

Nice to have

  • large-scale model training
  • async RL systems
  • high-throughput ML infrastructure
  • performance optimization
  • scaling
  • production-critical infrastructure
  • working directly with researchers
  • fast-moving model teams

What the JD emphasized

  • reinforcement learning training
  • frontier agents
  • multi-agent capabilities
  • memory
  • calibrated thinking
  • scaling
  • orchestration
  • inference bottlenecks
  • numerical problems
  • hardware failures
  • RL training runs
  • training systems
  • distributed infrastructure
  • training reliability
  • distributed systems
  • latency
  • cost
  • model behavior
  • training data
  • RL systems
  • evaluation infrastructure
  • serving systems
  • agent harnesses

Other signals

  • reinforcement learning training
  • frontier agents
  • large-scale RL training runs
  • scaling and orchestration issues
  • inference bottlenecks
  • numerical problems
  • hardware failures
  • multi-agent capabilities
  • memory
  • calibrated thinking