Lead Software Engineer - Applied AI ML Lead

JPMorgan Chase JPMorgan Chase · Banking · Palo Alto, CA +1 · Corporate Sector

Lead Software Engineer focused on applying AI/ML within enterprise infrastructure platforms. The role involves designing, developing, and productionizing GenAI/agentic AI solutions, implementing MLOps best practices, and owning the AI/ML optimization strategy. Emphasis on integrating AI-assisted engineering practices and ensuring responsible AI use.

What you'd actually do

  1. Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
  2. Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
  3. Design, develop, and productionize GenAI/agentic AI solutions for automation, decision support, and operational workflows, including LLM/SLM apps such as RAG and summarization/extraction.
  4. Build prompt engineering assets, routing strategies, and guardrails, and implement automated plus human-in-the-loop evaluation to improve quality.
  5. Apply MLOps best practices across experimentation, versioning, CI/CD, deployment, monitoring, and lifecycle management; implement testing/benchmarking and observability; define success metrics/governance with stakeholders; and mentor engineers to uphold high standards.

Skills

Required

  • Formal training or certification on software engineering concepts and 5+ years applied experience.
  • Hands-on practical experience delivering system design, application development, testing, and operational stability
  • Advanced in one or more programming language(s)
  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
  • Proficient in all aspects of the Software Development Life Cycle
  • Strong hands-on data engineering stack: Apache Spark (batch optimization, partitioning, shuffle tuning, reliability), Apache Airflow (DAG design, backfills, alerting, operational reliability, CI patterns), and Apache Iceberg (schema evolution, partition specs, snapshots, compaction).
  • Proven applied AI/ML and GenAI delivery with measurable impact (RAG, extraction, summarization, ranking/classification, copilots, evaluation) and demonstrated ability to lead across teams and influence technical standards and execution.
  • Deep distributed systems + production engineering expertise across APIs/microservices, CI/CD, observability, containers/Kubernetes, security, and reliability.

Nice to have

  • Experience with MCP (Model Context Protocol), Agent Skills, and structured agentic architectures.
  • Strong practical usage of AI engineering productivity tooling (for example, GitHub Copilot, Claude Code) in enterprise SDLC environments.
  • Familiarity with VSI and Cloud Foundry contexts.
  • Advanced Java engineering proficiency in addition to Python.
  • Expert-level Python for production systems (packaging, dependency management, performance); strong Java proficiency is a plus.

What the JD emphasized

  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices
  • Proven applied AI/ML and GenAI delivery with measurable impact (RAG, extraction, summarization, ranking/classification, copilots, evaluation) and demonstrated ability to lead across teams and influence technical standards and execution.

Other signals

  • Design, develop, and productionize GenAI/agentic AI solutions
  • Apply MLOps best practices
  • Own and govern the end-to-end AI/ML optimization strategy