Ai/llm Product Manager - Senior Associate

JPMorgan Chase JPMorgan Chase · Banking · New York, NY +1 · Commercial & Investment Bank

Product Manager role focused on building and shipping end-to-end AI/LLM-powered agentic systems for a large, regulated financial institution. Responsibilities include defining requirements, leading delivery, building infrastructure, driving model validation and monitoring, and ensuring alignment with governance and compliance standards.

What you'd actually do

  1. Define product requirements, features, and roadmap components for AI use cases, translating business problems into agentic solutions and workflows.
  2. Lead end-to-end delivery from pilot through production, owning what the agent does, what it is permitted to do, how it acts under uncertainty, and where autonomy boundaries sit.
  3. Build and extend the agents and the net-new infrastructure they depend on: the services, APIs, and integrations that surround the model and make the system work.
  4. Drive model validation, performance monitoring, drift detection, and iterative improvement, keeping behavior correct as you ship and extend.
  5. Manage backlog prioritization, sprint planning, and delivery tracking.

Skills

Required

  • 3–6+ years in product management, data products, or technology delivery, or equivalent expertise.
  • Have shipped an LLM-powered, autonomous, or agentic system to production
  • Demonstrated experience designing and running evals for such systems as needed to meet product driven success criteria.
  • Strong understanding of the AI/ML lifecycle (training, validation, deployment, monitoring)
  • Understanding of production-grade data judgment: what good data looks like, where it degrades, pipeline stability, and how quality propagates into behavior.
  • Experience building net-new infrastructure and integrations, with the ability to hold your own on architecture, APIs, and data pipelines.
  • Experience working with cross-functional teams (Tech, Data Science, Business), with strong communication and stakeholder-management skills.
  • Comfort operating inside a large, regulated institution where governance and controls are design inputs, not obstacles.
  • Ability to ship AI-enabled products and lead complex programs in large, matrixed organizations.

Nice to have

  • Previous experience in commercial and investment banking a plus

What the JD emphasized

  • shipped an LLM-powered, autonomous, or agentic system to production
  • running evals for such systems
  • operating inside a large, regulated institution

Other signals

  • AI/LLM Product Manager
  • building the next generation of AI and autonomous agents
  • own AI use cases end-to-end
  • design, build, and extend production-grade agentic systems
  • accountable for performance, safety, and day-to-day behavior
  • shipped an LLM-powered, autonomous, or agentic system to production
  • designing and running evals for such systems
  • operating inside a large, regulated institution