Product Manager, Compute Platform

Anthropic Anthropic · AI Frontier · New York, NY +2 · Remote · Product Management, Support, & Operations

Product Manager for Anthropic's Compute Platform, responsible for scheduling, orchestration, and capacity management systems for GPU and accelerator clusters. This role impacts cluster utilization, cost efficiency, and researcher velocity by defining job scheduling, resource guarantees, and supporting diverse workloads like training, fine-tuning, inference, and evaluation.

What you'd actually do

  1. Deeply understand the needs of internal customers across Research, Infrastructure, Product, and Finance—from researchers who need guaranteed resources for multi-week training runs to platform teams managing inference workloads with strict latency SLAs.
  2. Define and iterate on the semantic layer for job scheduling: the abstractions, priority tiers, resource classes, and preemption policies that govern how work flows through our compute clusters.
  3. Partnering with engineering leads to design scheduling capabilities that maximize cluster utilization while honoring resource guarantees—ensuring jobs have the right prerequisites (data, checkpoints, hardware affinity) validated before launch to avoid wasted compute.
  4. Drive product strategy and roadmap for compute capacity management, including quota systems, fairness policies, bin-packing optimizations, and gang-scheduling for distributed workloads.
  5. Own the trade-off framework between utilization efficiency, job latency, cost, and reliability—making transparent prioritization decisions and communicating them clearly to senior leadership.

Skills

Required

  • 7+ years of product management experience
  • deep exposure to compute infrastructure, distributed systems, or scheduling/orchestration platforms
  • Ability to internalize complex technical systems (job schedulers, cluster managers, resource orchestrators) and translate that understanding into a comprehensive product vision
  • Fluent across functions—you’re equally credible discussing scheduling algorithms with engineers, capacity economics with finance, and infrastructure strategy with leadership
  • Scrappy and resourceful—you do what it takes to get things done in a fast-moving environment

Nice to have

  • Built or scaled job scheduling, resource orchestration, or workload management systems for large-scale compute clusters (e.g., Kubernetes, Slurm, Borg, YARN, or custom schedulers).
  • Deep familiarity with GPU/accelerator scheduling challenges, including gang-scheduling, topology-aware placement, preemption, and hardware affinity constraints.
  • Experience defining and enforcing SLAs and resource guarantees for compute workloads—including mechanisms to validate job prerequisites (data readiness, checkpoint availability, hardware compatibility) before scheduling to avoid wasted resources.
  • Capacity planning experience across cloud and on-premises infrastructure, including cost modeling, demand forecasting, and vendor management for compute procurement.
  • Scales through hypergrowth in compute-intensive environments (AI/ML, HPC, large-scale cloud infrastructure).
  • Experience with observability and efficiency tooling for distributed infrastructure—building dashboards, automation, and governance workflows that drive utilization and cost accountability.

What the JD emphasized

  • built something from the ground up and grown it to serve demanding internal or external customers
  • Track record of building platform products that balance the needs of multiple users and stakeholders
  • comfortable making prioritization trade-offs between utilization, latency, cost, and fairness, and communicating them clearly
  • internalize complex technical systems (job schedulers, cluster managers, resource orchestrators)
  • Strong instinct for connecting technical decisions to business outcomes
  • every percentage point of cluster utilization has measurable impact
  • Built or scaled job scheduling, resource orchestration, or workload management systems for large-scale compute clusters
  • Deep familiarity with GPU/accelerator scheduling challenges
  • Experience defining and enforcing SLAs and resource guarantees for compute workloads
  • Capacity planning experience across cloud and on-premises infrastructure
  • Scales through hypergrowth in compute-intensive environments (AI/ML, HPC, large-scale cloud infrastructure)
  • Experience with observability and efficiency tooling for distributed infrastructure