Lead Machine Learning Engineer - Generative AI and Agent Platforms

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Commercial & Investment Bank

Lead Machine Learning Engineer focused on building and shipping production AI agents and agent platforms within a regulated financial services environment. The role involves end-to-end ownership of agent solutions, including retrieval systems, agent memory, multi-agent workflows, evaluation frameworks, and deployment on cloud platforms, with a strong emphasis on safety, compliance, and operational excellence.

What you'd actually do

  1. Design and deliver production AI agents across a federated portfolio, owning solutions from prototype through launch and operational support
  2. Engineer retrieval systems that perform reliably in production, including hybrid retrieval-augmented generation patterns (vector search plus graph-based retrieval where appropriate) with robust chunking, ranking, and grounding approaches
  3. Implement agent memory patterns, including episodic and semantic memory with recall, summarization, and decay policies aligned to use-case needs
  4. Orchestrate multi-agent workflows and integrate external tools and data sources through secure connectors and standardized tool interfaces
  5. Develop evaluation frameworks, including task-level and end-to-end evaluations, regression suites, automated scoring, and release gates for quality and safety

Skills

Required

  • Formal training or certification on applied AI and machine learning concepts and 5+ years applied experience
  • Bachelor’s degree in Computer Science, Engineering, Statistics, Mathematics, or a related field, or equivalent practical experience
  • Minimum 7 years of software development experience, including at least 4 years delivering artificial intelligence or machine learning solutions
  • Hands-on experience building large language model–powered or agentic applications in production, including tracing, evaluations, and safety guardrails
  • Strong programming skills in Python, including strong fundamentals in data structures, algorithms, and applied statistics
  • Practical experience with retrieval-augmented generation, including embedding strategies, retrieval quality measurement, and use of vector databases
  • Proficiency operating production workloads in at least one of the following: Amazon Web Services, Microsoft Azure, or Kubernetes
  • Experience designing data models and building systems using both SQL and NoSQL technologies for real-time or near-real-time use cases
  • Strong communication skills and the ability to partner effectively with senior technical and business stakeholders

Nice to have

  • Experience with agent frameworks and multi-agent orchestration patterns, including agent-to-agent coordination and Model Context Protocol integrations
  • Experience with knowledge graphs and graph databases to improve retrieval quality, explainability, and audit readiness
  • Understanding of model optimization techniques, including fine-tuning approaches and efficient inference for smaller models
  • Experience developing user-facing applications using modern JavaScript or TypeScript frameworks for agent user interfaces
  • Experience delivering AI solutions in financial services or payments environments with high reliability and control expectations
  • Familiarity with Go or Rust for performance-sensitive services

What the JD emphasized

  • production AI agents
  • regulated environment
  • AI/ML control expectations
  • agentic operation system and runtime
  • enterprise scale
  • safety guardrails
  • high reliability and control expectations

Other signals

  • building and shipping agents
  • production AI agents
  • agentic operation system and runtime
  • enterprise scale
  • regulated environment