Senior Machine Learning Engineer, Personalization, Magenta

Spotify Spotify · Consumer · New York, NY · Personalization

Senior Machine Learning Engineer focused on building production-grade machine learning systems for conversational and agentic AI experiences, including user intent interpretation, context management, multi-turn interactions, and tool orchestration. The role involves creating evaluation frameworks and balancing experimentation with production rigor.

What you'd actually do

  1. Design and ship production-grade machine learning systems powering conversational and agentic AI experiences
  2. Build systems that interpret user intent, manage context across multi-turn interactions, and handle ambiguity reliably at scale
  3. Develop and evolve agentic workflows including memory, context management, and multi-step tool orchestration
  4. Create evaluation frameworks, including LLM-as-judge pipelines, to measure quality and guide iteration
  5. Partner closely with product, engineering, and design to deliver seamless, user-facing experiences

Skills

Required

  • Machine learning systems design
  • Conversational AI
  • Agentic AI
  • User intent interpretation
  • Context management
  • Multi-turn interaction handling
  • Tool orchestration
  • Evaluation framework creation
  • LLM-as-judge pipelines
  • Production rigor
  • Performance optimization
  • Latency optimization
  • Reliability engineering

Nice to have

  • Product partnership
  • Engineering partnership
  • Design partnership

What the JD emphasized

  • production-grade
  • at scale
  • multi-turn interactions
  • agentic workflows
  • evaluation frameworks
  • LLM-as-judge
  • performance, latency, and reliability

Other signals

  • conversational AI
  • agentic AI
  • multi-turn interactions
  • tool orchestration
  • LLM-as-judge