Sr Software Dev Engineer, Machine Learning, Sponsored Products and Brands Ads Response Prediction

Amazon Amazon · Big Tech · Palo Alto, CA · Software Development

This role focuses on enhancing the scalability, automation, and efficiency of large-scale training and real-time inference systems for Amazon Ads' Sponsored Products and Brands. The engineer will pioneer LLM inference infrastructure and work with applied scientists to optimize ML models and infrastructure, implementing end-to-end solutions. The team builds advanced ML models and infrastructure, from training to inference, including LLM-based systems, to deliver relevant ads.

What you'd actually do

  1. Enhance the scalability, automation, and efficiency of large-scale training and real-time inference systems.
  2. Pioneer the development of LLM inference infrastructure to support next-generation GenAI workloads at Amazon Ads scale.
  3. Work closely with applied scientists to optimize the performance of machine-learning models and infrastructure, and implement end-to-end solutions.

Skills

Required

  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience as a mentor, tech lead or leading an engineering team

Nice to have

  • 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Bachelor's degree in computer science or equivalent

What the JD emphasized

  • large-scale training
  • real-time inference
  • LLM inference infrastructure

Other signals

  • large-scale training
  • real-time inference
  • LLM inference infrastructure
  • optimize performance of machine-learning models and infrastructure
  • implement end-to-end solutions