Senior Software Engineer - Infrastructure and Tools

Databricks Databricks · Data AI · San Francisco, CA · Engineering - Pipeline

Senior Software Engineer focused on building and extending the core Databricks infrastructure platform, which supports Big Data and AI workloads. Responsibilities include architecting multi-cloud systems, improving software development workflows, and developing automated build, test, and release infrastructures.

What you'd actually do

  1. Build and extend components of the core Databricks infrastructure
  2. Architect multi-cloud systems and abstractions to allow the Databricks product to run on top of existing Cloud providers
  3. Improve software development workflows for engineering and operational efficiency.
  4. Use our own data and AI platform (yes!) to analyze build and test logs and metrics to identify areas for improvement.
  5. Develop automated build, test, and release infrastructures.

Skills

Required

  • BS (or higher) in Computer Science, or a related field
  • 5+ years of experience writing production code in one of: Java, Scala, Go, C++ or Python
  • Passion for building highly scalable and reliable infrastructure
  • Experience architecting, developing and deploying large-scale distributed systems at scale
  • Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
  • Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes, or Terraform.