Senior Software Engineer - Data + AI Observability

Databricks Databricks · Data AI · Bangalore, India · Engineering - Pipeline

Databricks is seeking a Senior Software Engineer to lead the development of products for AI and data observability. This role involves building data infrastructure to process billions of entries daily, deploying globally, and enabling companies to manage their DevOps, FinOps, SecOps, and AIOps. The engineer will lead technical development, mentor others, optimize scalability and cost, and drive integrations.

What you'd actually do

  1. Develop systems that make it simple for customers to answer questions about their Databricks environment by providing a reliable and timely interface for observability
  2. Make it easy for frameworks teams across Databricks to publish their data to customers
  3. Effectively lead large milestones from the observability roadmap, contribute to the long-term vision and requirements development for Databricks products
  4. Mentor other engineers towards contributing to the product and their career growth
  5. Optimize the scalability and cost of large data pipelines towards reducing costs for customers and opening up new product opportunities

Skills

Required

  • 6+ years of production level experience in one of: Java, Scala, Python, C++, or similar language
  • Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes
  • Proven track record in architecting, developing, deploying, and operating components of large scale distributed systems
  • Strong software engineering maturity: security, correctness, engineering excellence, operational excellence
  • Platform mindset: effective building platforms for other software teams, iterating quickly to reduce friction to adoption, advocating for platform use
  • Cross-functional skills

What the JD emphasized

  • Proven track record in architecting, developing, deploying, and operating components of large scale distributed systems
  • effective building platforms for other software teams