Senior Product Manager - AI Quality

Uber Uber · Consumer · Bangalore, India · Product

Product Manager role focused on defining the future of agentic Conversational AI at Uber, specifically on building, testing, and scaling intelligent agents. The role involves working across AI reasoning, evaluation infrastructure, and platform tools for AI assistants in customer support environments. Requires strong product management fundamentals and practical experience building AI/LLM products, with a focus on agents, platforms, model evaluation, or intelligent tools.

What you'd actually do

  1. Own roadmaps and prioritize work that balances long-term platform investments with short-term needs from various product teams - ensuring alignment with company objectives.
  2. Advocate for the end-user by integrating design thinking and user research, ensuring AI products deliver delightful experiences.
  3. Deeply engage with AI engineering teams to align and execute the product strategy for platform capabilities that improve how AI agents are evaluated, understood, and launched—including testing frameworks, benchmarking infrastructure, and observability tools.
  4. Utilize data to prioritize features, make informed trade-offs, and continually enhance product performance.
  5. Work closely with engineering, AI/ML, and data science teams to design scalable systems that improve iteration speed and reliability across conversational AI products.

Skills

Required

  • 5+ years of product management experience
  • 2+ years working on AI/ML or LLM-driven tech
  • Strong understanding of large language models, AI agent patterns, and ML workflows
  • Demonstrated ability to ship technical products with cross-functional teams
  • Exceptional ability to articulate complex AI concepts and product strategies

Nice to have

  • Experience working on LLM evaluations, simulations, building AI agents and/or ML workflows
  • Strong understanding of large language models, how they work and how to best measure quality of AI agents
  • Fluency with Claude Code/Cursor

What the JD emphasized

  • AI Quality
  • evaluation infrastructure
  • platform tools
  • AI agents
  • evaluations
  • AI agents
  • measure quality of AI agents

Other signals

  • AI Quality
  • Agentic Conversational AI
  • Evaluation Infrastructure
  • Platform Tools
  • AI Agents