Senior Product Manager – Conversational AI Servicing Quality Assurance

Capital One Capital One · Banking · McLean, VA +2

Product Manager role focused on the quality assurance and evaluation of conversational AI solutions within an enterprise setting. The role involves driving the integration and roadmap for onboarding AI solutions onto a quality platform, pioneering AI QA capabilities, and scaling automated assessments for consistency and accuracy.

What you'd actually do

  1. Drive Conversational AI Integration: Own the end-to-end platform integration and roadmap execution required to successfully onboard conversational AI solutions onto our enterprise quality assurance platform.
  2. Pioneer AI QA & Feedback Loops: Support the development of advanced "AI QA on AI" capabilities. You will help establish automated assessment parameters and closed-loop feedback systems that empower conversational AI to continuously learn and self-correct.
  3. Scale Automated Assessments: Design the systems that allow our automated QA platform to keep pace with rapid coverage expansion. You will ensure our quality assurance checks remain highly consistent, accurate, and scalable as we expand evaluation across a vast library of complex customer intents and tasks.

Skills

Required

  • Product Management
  • Conversational AI
  • Quality Assurance
  • LLM evaluation pipelines
  • Platform integration
  • Roadmap execution
  • Automated assessment systems
  • Quantitative field degree

Nice to have

  • Translating business strategy and analysis into consumer facing digital products

What the JD emphasized

  • conversational AI solutions
  • enterprise quality platform
  • AI QA on AI
  • automated assessment parameters
  • automated QA platform
  • quality assurance checks

Other signals

  • scaling automated validation
  • evaluating conversational AI solutions
  • enterprise quality platform