Senior Software Engineer - Application Traffic Team

Databricks Databricks · Data AI · San Francisco, CA · Engineering - Pipeline

Senior Software Engineer on the Application Traffic team responsible for designing and building systems for Databricks' service-to-service communication across thousands of clusters in a multi-cloud environment. This includes creating abstractions for connectivity, discovery, and reliability, as well as building control planes for ingress, service discovery, load balancing, and overload protection mechanisms like rate limiting and admission control.

What you'd actually do

  1. Build the control plane for Databricks’ global ingress layer.
  2. Design scalable mechanisms for service discovery and load balancing across thousands of clusters.
  3. Build intelligent rate limiting and admission control systems to protect critical services under high load.

Skills

Required

  • BS (or higher) in Computer Science or related field
  • 5+ years of experience designing and building large-scale distributed systems
  • Strong proficiency in one or more languages such as Java, Scala, Go, or C++
  • Experience with service-oriented architectures and large scale distributed systems
  • Familiarity with cloud platforms (AWS, Azure, GCP) and container/orchestration technologies (Kubernetes, Docker)
  • Track record of shipping infrastructure that supports mission-critical workloads at scale

Nice to have

  • service discovery
  • DNS
  • load balancing
  • Envoy
  • related networking systems

What the JD emphasized

  • large-scale distributed systems
  • shipping infrastructure that supports mission-critical workloads at scale