Senior Technical Program Manager, Customer Engagement, Applied AI

Google Google · Big Tech · London, United Kingdom

Senior Technical Program Manager for Google Cloud Applied AI Solutions Consulting team, focusing on enterprise AI deployments. The role involves leading the delivery of production-ready agentic AI solutions for customers, managing cross-functional teams, defining agent behaviors, and ensuring technical roadmaps align with business goals. This includes overseeing the implementation of evaluation pipelines and monitoring agent health using specialized dashboards.

What you'd actually do

  1. Lead the implementation of evaluation pipelines and testing frameworks, ensuring every Large Language Model (LLM) prompt or reasoning update is validated against benchmark datasets to prevent regressions in agent accuracy, persona alignment, and brand voice.
  2. Utilize specialized dashboards to monitor agent health, tracking Key Performance Indicators (KPIs) such as accuracy, hallucination rates, and latency to ensure the agent is production ready and provides a fluid, human-like experience.
  3. Be a thought leader within Google and industry on the subject matter domain of the respective organization.
  4. Establish a reliable and visible cadence for portfolio reviews, decision-making, prioritization, and resource management, whereby improvements are measurable and the impact can be felt organization wide.
  5. Lead the implementation of evaluation pipelines and testing frameworks, ensuring every Large Language Model (LLM) prompt or reasoning update is validated against benchmark datasets to prevent regressions in agent accuracy, persona alignment, and brand voice.

Skills

Required

  • program management
  • AI agents
  • generative AI native architectures
  • technical roadmaps
  • customer interactions

Nice to have

  • cross-functional project management
  • cross-team project management

What the JD emphasized

  • Experience working with AI agents and generative AI native architectures.
  • Experience leading customer interactions.

Other signals

  • AI agents
  • generative AI
  • LLM
  • customer engagement
  • production-ready solutions