Manager Ii, Engineering - AI Platform Training, Serving and Storage (noram)

Datadog Datadog · Enterprise · New York, NY · Leadership

Manager II, Engineering for Datadog's AI Platform, focusing on training, serving, and storage. This role involves leading teams, defining roadmaps, and shaping the technical vision for AI infrastructure that supports large-scale training and inference. The position requires experience in building ML/AI platforms, managing managers, and fostering a strong engineering culture.

What you'd actually do

  1. Lead a fast-growing organization around 20 people across 2 teams soon to be 3.
  2. You will define the roadmap for your scope and work with ICs and managers to establish the technical direction
  3. Collaborate with the engineering team and product manager to define the future of the roadmap
  4. Create a strong organizational culture centered around our engineering standards and customer- focused approach
  5. Support the whole lifecycle of AI development, including model training, serving, deployment and monitoring

Skills

Required

  • Experience leading teams that have built 0 to 1 ML/AI Platforms
  • Experience managing managers
  • Strong technical skills to influence technical direction
  • Experience building and leading high-performing software engineering teams
  • Experience working on early stage projects with challenges and fast iteration cycles
  • Strong bias for delivery and making impact through ambiguity
  • Track record of delivering high-quality software on schedule
  • Collaborating closely with product partners

Nice to have

  • Emphasis on Open Source Tooling (i.e. Ray / AnyScale)

What the JD emphasized

  • manage other managers
  • build 0 to 1 ML/AI Platforms
  • manage managers

Other signals

  • AI infrastructure
  • large-scale training and inference
  • manage other managers
  • build and scale teams