Sr Software Engineer - AI Platform (michelangelo)

Uber Uber · Consumer · Seattle, WA +1 · Engineering

Uber's ML Serving team is seeking a Senior Software Engineer to build and operate large-scale, low-latency systems for real-time ML and generative AI inference. The role involves leading the design and ownership of critical serving services and frameworks, partnering with ML engineers to productionize models, and improving system reliability and performance.

What you'd actually do

  1. Design, build, and own scalable ML serving services and infrastructure components
  2. Drive technical design decisions and lead the implementation of complex systems
  3. Partner with ML engineers and platform teams to productionize ML and generative AI models
  4. Improve system reliability, performance, and operational excellence through automation and tooling
  5. Mentor junior engineers and contribute to team-wide engineering best practices

Skills

Required

  • Software Engineering
  • Java
  • Go
  • Python
  • C++
  • system design
  • data structures
  • algorithms
  • ML serving
  • inference pipelines
  • real-time ML systems

Nice to have

  • high-throughput distributed systems
  • low-latency distributed systems
  • ML frameworks
  • model lifecycle concepts
  • deployment
  • versioning
  • monitoring
  • ownership
  • mentoring
  • collaboration

What the JD emphasized

  • production-grade backend or distributed systems
  • design, ship, and operate scalable services end to end
  • ML serving, inference pipelines, or real-time ML systems in production
  • high-throughput, low-latency distributed systems

Other signals

  • ML Serving
  • low-latency systems
  • real-time ML inference
  • generative AI inference
  • productionize ML models