Ai/llm Product Manager - Senior Associate

JPMorgan Chase JPMorgan Chase · Banking · Palo Alto, CA +1 · Commercial & Investment Bank

Product Manager role focused on delivering enterprise AI/LLM-powered search capabilities within a financial services context. The role involves supporting product strategy, defining features, and overseeing the integration of technologies like RAG, Agents, SFT, and RLHF, while ensuring scalability, security, and regulatory compliance.

What you'd actually do

  1. Assist in developing and communicating a clear product vision and strategy for both conventional Search and Large Language Model (LLM)-based conversational User Interface (UI) initiatives within GB.
  2. Leverage a wide range of cutting-edge technologies such as Semantic Search, Personalized Search, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), Retrieval-Augmented Generation (RAG), and Agents to enhance user experiences.
  3. Incorporate established search methodologies and technologies, including Boolean Search, Keyword Search, Faceted Search, and Full-Text Search, to improve overall search capabilities and user experience.
  4. Collaborate with internal stakeholders, including business leaders, data scientists, engineers, and designers, to gather requirements, define product features, and ensure successful product delivery.
  5. Oversee the integration and release of Search and LLM technologies into GB products and services. Ensure that solutions are scalable, secure, and compliant with regulatory requirements.

Skills

Required

  • 3-5+ years of building and launching AI / LLM products
  • Strong collaboration skills
  • Knowledge of AI/LLM and data product lifecycle
  • Familiarity with ElasticSearch, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), RAG, and Agents
  • Knowledge of LLM frameworks such as LangChain, LangGraph, and OpenLLM
  • Understanding of operationalizing AI products responsibly through MLOps pipeline
  • Basic expertise in Cloud computing and architecture (e.g., AWS)

Nice to have

  • Search Product expeirence
  • Experience in Financial Services or other highly regulated industries

What the JD emphasized

  • building and launching AI / LLM products
  • AI/LLM
  • data product lifecycle
  • operationalizing AI products responsibly
  • highly regulated industries

Other signals

  • AI/LLM
  • enterprise Search
  • product delivery
  • stakeholder collaboration