Sr. Staff Software Engineer - Data Platform

Databricks Databricks · Data AI · Mountain View, CA · Engineering

Databricks is seeking a Sr. Staff Software Engineer to join their Data Platform organization. This role will leverage AI developer tools and techniques to build the Data Intelligence Platform, automating decision-making across Databricks. The engineer will define the future of tools spanning logging, orchestration, data transformation, metric store, governance, and data consumption. Responsibilities include designing and running the Data Intelligence Platform, developing tooling for Databricks on Databricks at scale, partnering with tech leaders, acting as customer 0, and representing Databricks at conferences. The ideal candidate has 15+ years of experience in large-scale distributed systems, 6+ years of technical leadership in production data systems, and experience with performance-sensitive systems.

What you'd actually do

  1. Design and run the cross-company Data Intelligence Platform, which contains every business and product metric used to run Databricks. You’ll play a key role in developing the right balance of data protection and ease of shareability for the Data Intelligence Platform as we transition to a public company.
  2. Develop tooling and infrastructure to efficiently manage and run Databricks on Databricks at scale, across multiple clouds, geographies, and deployment types. This includes CI/CD processes, test frameworks for pipelines and data quality, and infrastructure-as-code tooling.
  3. Partner with other prominent tech leaders to develop and influence technical direction and capabilities of our Databricks product.
  4. Be customer 0 and a trusted advisor to product leadership.
  5. Represent Databricks at academic and industrial conferences & events.

Skills

Required

  • 15+ years of industry experience building and operating large-scale distributed systems
  • 6+ years of experience providing technical leadership on planet-scale production data systems
  • Experience leading architecture efforts for performance-sensitive systems (e.g., latency-critical services, multi-tenant platforms, large-scale indexing pipelines)
  • Strong communication skills
  • Strategic mindset

Nice to have

  • BS/MS/PhD in Computer Science or related majors, or equivalent experience
  • Passion for mentoring and developing other engineers

What the JD emphasized

  • AI first mindset
  • 15+ years of industry experience building and operating large-scale distributed systems
  • 6+ years of experience providing technical leadership on planet-scale production data systems
  • Experience leading architecture efforts for performance-sensitive systems