Lead Software Engineer - Agentic Ai/java/python

JPMorgan Chase JPMorgan Chase · Banking · Plano, TX +1 · Consumer & Community Banking

Lead Software Engineer role focused on building and scaling agentic AI systems within a financial services context. The role involves designing, developing, and troubleshooting complex technology solutions, with a strong emphasis on integrating AI-assisted engineering practices and ensuring responsible AI use. Requires hands-on experience with LLMs/SLMs, Java/Python, AWS, and understanding of LLM patterns like function calling, RAG, and guardrails.

What you'd actually do

  1. Executes software solutions, design, development, and technical troubleshooting, thinking beyond routine approaches to solve complex problems.
  2. Creates secure, high-quality production code and maintain algorithms that run synchronously with appropriate systems.
  3. Produces architecture and design artifacts for complex applications, ensuring design constraints are met by software code development.
  4. Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets to drive continuous improvement of software applications and systems.
  5. Proactively identifies hidden problems and patterns in data, using insights to drive improvements in coding hygiene and system architecture.

Skills

Required

  • 5+ years of software engineering experience
  • 2+ years building complex scalable applications or agentic systems
  • Hands-on experience building agentic systems using LLMs/SLMs
  • Experience setting up and maintaining MCP servers and building MCP-compatible tools/adapters
  • Proficient in coding in one or more languages: Java and/or Python
  • Proficiency building production services with either Spring AI or the Spring ecosystem (Spring Boot, Spring Security, Spring Cloud), or Python (FastAPI/Flask), with typed contracts, testing, and packaging.
  • Solid AWS background with working knowledge of ECS or EKS, containerization (Docker), and CI/CD (GitHub Actions/Jenkins/CodeBuild).
  • Strong API design skills (REST/OpenAPI; gRPC and familiarity with observability stacks (e.g., Splunk, CloudWatch, Prometheus/Grafana, OpenTelemetry).
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails.
  • Strong testing culture: unit/integration tests, load tests, and evaluation datasets for agents.
  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices

Nice to have

  • Expertise with distributed orchestration patterns for LLM applications (graph-based flows, retries, fallbacks, guardrails) and secure integration with enterprise tools and data.
  • Experience with safe rollout strategies (shadowing, A/B testing, progressive exposure), human-in-the-loop review, and continuous evaluation for quality and safety, including canary rollouts.
  • Knowledge of API gateways, service mesh, and multi-region high availability and disaster recovery for mission-critical services.
  • Familiarity with data privacy, security best practices, and regulatory compliance in financial services.
  • Experience with performance optimization, scalability, and reliability engineering for large-scale systems.
  • Ability to evaluate and integrate third-party tools, libraries, and frameworks to accelerate development.
  • Demonstrated leadership in technical communities, open source contributions, or industry forums.

What the JD emphasized

  • building complex scalable applications or agentic systems
  • LLMs/SLMs
  • Java and/or Python
  • AWS
  • API
  • Demonstrated experience leading effective use of approved AI-assisted software development tools
  • Strong understanding of responsible AI use in engineering workflows

Other signals

  • building complex scalable applications or agentic systems
  • Hands-on experience building agentic systems using LLMs/SLMs
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails
  • Demonstrated experience leading effective use of approved AI-assisted software development tools
  • Strong understanding of responsible AI use in engineering workflows