Senior Applied ML Engineer - Ml4sys

Databricks Databricks · Data AI · San Francisco, CA · Engineering - Pipeline

Senior Applied ML Engineer to optimize Databricks infrastructure using ML, scheduling, and optimization algorithms. The role involves designing and deploying ML4Sys solutions, shaping the ML roadmap, and building production ML pipelines and serving components.

What you'd actually do

  1. Accelerate Serverless Growth: Drive the scaling and efficiency of Databricks serverless compute products through advanced optimization techniques.
  2. Build Systems: Design end-to-end ML4Sys solutions from the ground up within a lean team of domain experts to support
  3. Shape Strategy: Define the roadmap for applied ML investments by collaborating with engineering and product leaders across Databricks.
  4. Drive Deployment: Architect, train, and deploy state-of-the-art models that directly improve product performance and cost efficiency.
  5. Scale Infrastructure: Build robust ML pipelines, data processing layers, model serving components, and production monitoring systems to help scale

Skills

Required

  • Machine learning
  • Scheduling algorithms
  • Optimization algorithms
  • Python
  • Scala
  • Java
  • Cloud computing
  • Distributed systems
  • Modern data processing frameworks

Nice to have

  • PhD in AI, Data Science, or a related technical discipline
  • 4+ years of machine learning engineering experience
  • Computer architecture
  • Database internals
  • Networking
  • Operations research
  • Forecasting
  • Markov decision processes
  • Sequential decision making

What the JD emphasized

  • maximize the efficiency and performance of our infrastructure
  • highly optimized, cost-effective workloads
  • scaling and efficiency
  • optimize large-scale distributed systems or cloud infrastructure via data-driven approaches

Other signals

  • ML models for infrastructure optimization
  • End-to-end ML systems
  • Production ML pipelines
  • Model serving components