Staff Software Engineer - Backend

Databricks Databricks · Data AI · Seattle, WA +1 · Engineering - Pipeline

Databricks is seeking a Staff Software Engineer - Backend to work on their data and AI infrastructure platform. The role involves designing, implementing, testing, and operating micro-services for the Databricks platform, including building data pipelines, integrating with third-party applications, and interacting with cloud APIs. The engineer will work on highly technical products and push the boundaries of data and AI technology while ensuring resilience, security, and scale.

What you'd actually do

  1. work closely with your team and product management to prioritize, design, implement, test, and operate micro-services for the Databricks platform and product.
  2. writing software in Scala/Java, building data pipelines (Apache Spark, Apache Kafka), integrating with third-party applications, and interacting with cloud APIs (AWS, Azure, CloudFormation, Terraform).
  3. build services and infrastructure at the intersection of machine learning and distributed systems.
  4. Build the resource management infrastructure powering all the big data and machine learning workloads on the Databricks platform in a robust, flexible, secure, and cloud-agnostic way.
  5. Deliver reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store.

Skills

Required

  • Java
  • Scala
  • C++
  • distributed systems
  • SaaS platform
  • Service-Oriented Architectures
  • SQL
  • cloud technologies
  • AWS
  • Azure
  • GCP
  • Docker
  • Kubernetes

Nice to have

  • Apache Spark
  • Apache Kafka
  • CloudFormation
  • Terraform
  • software security
  • systems that handle sensitive data

What the JD emphasized

  • 10+ years of production level experience in one of: Java, Scala, C++, or similar language.
  • Experience in architecting, developing, deploying, and operating large scale distributed systems.
  • Experience working on a SaaS platform or with Service-Oriented Architectures.