Lead Software Engineer

JPMorgan Chase JPMorgan Chase · Banking · Columbus, OH +1 · Consumer & Community Banking

Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking (CCB) division, responsible for designing and building critical technology solutions across Chase AI components, including Chase Agent, Agent Operating Memory, Domain Agents, Agentic Experience Service, and Assurance. The role requires hands-on experience building agentic systems using LLMs/SLMs and proficiency in various programming languages and cloud technologies.

What you'd actually do

  1. Execute software solutions, design, development, and technical troubleshooting, thinking beyond routine approaches to solve complex problems.
  2. Create secure, high-quality production code and maintain algorithms that run synchronously with appropriate systems.
  3. Produce architecture and design artifacts for complex applications, ensuring design constraints are met by software code development.
  4. Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets to drive continuous improvement of software applications and systems.
  5. Proactively identify hidden problems and patterns in data, using insights to drive improvements in coding hygiene and system architecture.

Skills

Required

  • 5+ years of software engineering experience
  • 2+ years building complex scalable applications or agentic systems
  • Hands-on experience building agentic systems using LLMs/SLMs
  • Experience setting up and maintaining MCP servers and building MCP-compatible tools/adapters
  • Proficient in coding in one or more languages: Java, Python
  • Proficiency building production services with either Spring AI and the Spring ecosystem (Spring Boot, Spring Security, Spring Cloud), or Python (FastAPI/Flask), with typed contracts, testing, and packaging.
  • Solid AWS background with working knowledge of ECS or EKS, containerization (Docker), and CI/CD (GitHub Actions/Jenkins/CodeBuild).
  • Strong API design skills (REST/OpenAPI; gRPC)
  • familiarity with observability stacks (e.g., Splunk, CloudWatch, Prometheus/Grafana, OpenTelemetry).
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails.
  • Strong testing culture: unit/integration tests, load tests, and evaluation datasets for agents.
  • Excellent communication and cross-functional collaboration skills.
  • Experience with agile methodologies and working in fast-paced, iterative development environments.

Nice to have

  • Expertise with distributed orchestration patterns for LLM applications (graph-based flows, retries, fallbacks, guardrails) and secure integration with enterprise tools and data.
  • Experience with safe rollout strategies (shadowing, A/B testing, progressive exposure), human-in-the-loop review, and continuous evaluation for quality and safety, including canary rollouts.
  • Knowledge of API gateways, service mesh, and multi-region high availability and disaster recovery for mission-critical services.
  • Familiarity with data privacy, security best practices, and regulatory compliance in financial services.
  • Experience with performance optimization, scalability, and reliability engineering for large-scale systems.
  • Ability to evaluate and integrate third-party tools, libraries, and frameworks to accelerate development.
  • Demonstrated leadership in technical communities, open source contributions, or industry forums.

What the JD emphasized

  • building complex scalable applications or agentic systems
  • building agentic systems using LLMs/SLMs
  • LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails

Other signals

  • building complex scalable applications or agentic systems
  • building agentic systems using LLMs/SLMs
  • LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails