Engineering Manager, Spark Connect

Databricks Databricks · Data AI · Bellevue, WA +1 · Engineering

Engineering Manager for Databricks' Spark Connect team, focusing on platform reliability, scalability, and open-source strategy for Databricks Serverless.

What you'd actually do

  1. Lead the team responsible for Spark Connect, a critical component of Databricks Serverless.
  2. Own platform reliability, scalability, and operational excellence.
  3. Drive Databricks’ technical leadership in open source Spark Connect.
  4. Define and execute the strategy for OSS Spark Connect adoption and ecosystem growth.
  5. Partner across product, runtime, serverless, and OSS stakeholders to shape roadmap and architecture.

Skills

Required

  • distributed systems
  • infrastructure
  • data platforms
  • engineering management
  • open source strategy
  • cross-functional leadership

Nice to have

  • Apache Spark
  • Databricks Serverless

What the JD emphasized

  • 10+ years of experience in distributed systems, infrastructure, or data platforms.
  • 3+ years of experience managing high-performing engineering teams.
  • Strong technical depth and a track record of owning critical production systems.