Sr. Software Engineer- Backend

Databricks Databricks · Data AI · New York, NY · Engineering

Databricks is seeking a Sr. Software Engineer for their AI Platform team to build and improve the infrastructure powering their AI offerings, including MLflow, AI Gateway, Agent Framework, and Foundation Model APIs. The role focuses on backend and infrastructure engineering, improving reliability, latency, and efficiency of distributed AI workloads, and collaborating with various teams to deliver end-to-end AI experiences. Experience with distributed systems, scalable APIs, cloud-native infrastructure, and bonus points for real-time serving, ML infrastructure, or GPU orchestration are desired.

What you'd actually do

  1. Build infrastructure that powers our flagship offerings like MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks, and Foundation Model APIs, to state a few.
  2. Improve reliability, latency, and efficiency of distributed AI workloads
  3. Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
  4. Shape how developers and data scientists build and interact with AI on Databricks

Skills

Required

  • Scala
  • Go
  • Python
  • distributed systems
  • scalable APIs
  • cloud-native infrastructure
  • service-oriented architecture
  • deployment pipelines
  • system observability
  • product and ownership mindset

Nice to have

  • real-time serving
  • ML infrastructure
  • GPU orchestration
  • SageMaker
  • Vertex AI
  • Azure ML
  • MLflow
  • PyTorch
  • Ray
  • developer platforms
  • internal tools supporting AI workflows

What the JD emphasized

  • high-agency, high-visibility team
  • frontier of AI infrastructure
  • deep ties to research, product, and real-world enterprise use cases
  • fastest-growing businesses
  • thousands of our customers democratize AI within their organizations
  • building the infrastructure that powers the next generation of AI
  • 5+ years of experience in backend or infrastructure engineering
  • Strong programming skills in Scala, Go, or Python
  • Experience with distributed systems, scalable APIs, or cloud-native infrastructure
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability
  • Strong product and ownership mindset

Other signals

  • powers flagship offerings like MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks, and Foundation Model APIs
  • improving reliability, latency, and efficiency of distributed AI workloads
  • building the infrastructure that powers the next generation of AI
  • building the substrate that powers everything from data apps, AI agents, model training, model serving, and vector search