Applied AI ML Lead - Agent Builder Platform

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Corporate Sector

Lead the technical design and delivery of agentic AI products and platform capabilities, focusing on building, evaluating, and operating AI agents safely at scale. This role involves establishing engineering standards, building operational capabilities, implementing safety and governance, and partnering with stakeholders to deliver measurable business impact.

What you'd actually do

  1. Lead end-to-end delivery of agentic AI and large language model-powered use cases from problem framing and technical design through production deployment and monitoring.
  2. Own core platform services and reusable components that enable teams to build, evaluate, and operate AI agents safely at scale.
  3. Establish engineering standards through hands-on system design, rigorous code review, and mentorship to improve reliability, maintainability, and developer experience.
  4. Build and operationalize evaluation, testing, and observability capabilities (tracing, metrics, logs, and analytics) to continuously improve solution quality.
  5. Implement robust safety and governance patterns, including guardrails, access controls, and audit-ready operational practices aligned to enterprise expectations.

Skills

Required

  • Formal training or certification on applied artificial intelligence and machine learning concepts
  • 5+ years applied experience
  • Advanced proficiency in Python
  • strong software engineering fundamentals, including testing, design patterns, version control, and code review practices.
  • Hands-on experience building, evaluating, and deploying machine learning or large language model-enabled systems into production environments.
  • Practical experience with prompt engineering and retrieval-augmented generation, including evaluation methods and quality measurement.
  • Experience designing and operating reliable services, including incident response readiness, performance tuning, and operational stability for data-intensive systems.
  • Demonstrated ability to lead technical decisions and deliver outcomes through ambiguity, balancing speed, risk, and long-term maintainability.
  • Strong communication skills with the ability to explain technical trade-offs to both technical and non-technical stakeholders.

Nice to have

  • Experience with agent orchestration frameworks (for example, LangGraph, LlamaIndex, Google ADK or custom orchestration)
  • Experience with evaluation tooling for large language model systems.
  • Experience with continuous integration and continuous delivery practices
  • containerization (Docker and Kubernetes) for production deployments.
  • Familiarity with vector databases, embedding pipelines, or graph-based memory approaches used in retrieval-augmented generation solutions.
  • Experience with cloud and machine learning platforms (for example, Amazon Web Services, Databricks, or comparable platforms).
  • Experience contributing to AI governance, validation approaches, or guardrail frameworks in enterprise settings.

What the JD emphasized

  • agentic artificial intelligence products—at scale
  • reliable production outcomes
  • agentic AI and large language model-powered use cases
  • build, evaluate, and operate AI agents safely at scale
  • evaluation, testing, and observability capabilities
  • robust safety and governance patterns, including guardrails
  • deliver measurable business impact
  • 5+ years applied experience
  • Hands-on experience building, evaluating, and deploying machine learning or large language model-enabled systems into production environments.
  • Practical experience with prompt engineering and retrieval-augmented generation, including evaluation methods and quality measurement.
  • Experience designing and operating reliable services
  • Demonstrated ability to lead technical decisions and deliver outcomes through ambiguity

Other signals

  • building and deploying agentic AI products at scale
  • platform that accelerates engineering teams
  • reliable production outcomes
  • lead the technical design and delivery of agentic AI products and platform capabilities