Senior Engineering Manager, AI Gateway

Cloudflare Cloudflare · Enterprise · Austin, TX · Emerging Technology and Incubation

Senior Engineering Manager for AI Gateway, leading a team to build and operate AI infrastructure, focusing on agents, tools, and developer experience. The role involves setting technical direction, hands-on coding, mentoring engineers, and partnering with other AI teams to deliver a unified inference layer.

What you'd actually do

  1. Set the technical and product direction for AI Gateway alongside engineers and PMs, then roll up your sleeves and help build it.
  2. Build the software and the software that builds the software. Your team needs to build the context and toolchain that let agents help build, operate, monitor, and improve AI Gateway itself.
  3. Inspire and energize a team shipping at the pace the AI ecosystem demands.
  4. Obsess over developer experience.
  5. Recruit, mentor, and grow engineers.
  6. Partner closely with Workers AI, Agents, and the broader Developer Platform teams to deliver a unified inference layer that feels like one product

Skills

Required

  • 8 years of relevant industry experience
  • 4 years managing software engineering teams
  • leading teams that have shipped and operated complex, large-scale systems
  • technical depth
  • guide architectural discussions
  • make credible technical decisions
  • review designs
  • unblock your team
  • hire, coach, and develop senior engineers
  • build high-performing, inclusive teams

Nice to have

  • AI infrastructure
  • developer platforms
  • cloud infrastructure
  • edge/proxy systems
  • high-scale APIs
  • developer tools taste
  • hands-on approach to leadership
  • building AI/ML infrastructure
  • inference platforms
  • model gateways
  • LLM-powered applications
  • building developer-facing APIs or SDKs at scale
  • proxy, edge, or gateway systems
  • built or heavily customized your own agentic dev environment
  • familiarity with the current AI ecosystem
  • track record of writing publicly about developer tools or systems
  • built something with AI Gateway, Workers AI, or a competing product

What the JD emphasized

  • deeply hands-on role
  • generative builder
  • obsessively agent-pilled
  • dogfood AI Gateway, Workers AI, and the broader Cloudflare agent stack relentlessly
  • shipping at the pace the AI ecosystem demands
  • Provider APIs change weekly, new models drop daily, and the gap between "good idea" and "in production" is measured in days, not quarters.
  • Proven track record leading teams that have shipped and operated complex, large-scale systems, preferably in AI infrastructure, developer platforms, cloud infrastructure, edge/proxy systems, or high-scale APIs.
  • Significant technical depth
  • Strong developer tools taste
  • Demonstrated ability to hire, coach, and develop senior engineers, and to build high-performing, inclusive teams that ship.
  • A hands-on approach to leadership: you consider yourself a builder, stay close to the code, know the numbers, know the customer, and know what to build next.
  • Experience building AI/ML infrastructure, inference platforms, model gateways, or LLM-powered applications.
  • You've built or heavily customized your own agentic dev environment: custom agents, harnesses, or tooling that changed how you ship.

Other signals

  • leading a team building AI Gateway
  • building agents, harnesses, skills, tools, and context for agents
  • dogfooding AI Gateway, Workers AI, and the broader Cloudflare agent stack
  • partnering with Workers AI, Agents, and broader Developer Platform teams
  • shipping and operating complex, large-scale systems in AI infrastructure