Staff Software Engineer
Uber is seeking a Staff Software Engineer to join their AI/ML team. This role focuses on developing and deploying large-scale ML models and services, optimizing inference performance, and productionizing novel ML techniques. The ideal candidate will have experience with distributed systems, ML infrastructure, and optimizing ML models for production environments.
What you'd actually do
- Design, build, and maintain scalable and reliable ML infrastructure and services.
- Optimize inference performance for latency and throughput of large-scale ML models.
- Collaborate with research scientists to productionize novel ML techniques and algorithms.
- Develop and implement monitoring, alerting, and logging for ML systems.
- Mentor junior engineers and contribute to the team's technical strategy.
Skills
Required
- Experience with distributed systems and cloud platforms (AWS, GCP, Azure)
- Proficiency in Python and/or C++
- Strong understanding of ML frameworks (TensorFlow, PyTorch)
- Experience with ML serving and inference optimization
- Experience with containerization technologies (Docker, Kubernetes)
Nice to have
- Experience with large language models (LLMs)
- Experience with MLOps tools and practices
- Experience with GPU optimization
What the JD emphasized
- large-scale ML models and services
- Optimize inference performance
- productionize novel ML techniques
Other signals
- Develop and deploy large-scale ML models and services
- Optimize inference performance for latency and throughput
- Collaborate with research scientists to productionize novel ML techniques