Lead Software Engineer

JPMorgan Chase JPMorgan Chase · Banking · Columbus, OH +1 · Consumer & Community Banking

Lead Software Engineer for JPMorgan Chase's Consumer & Community Banking division, focusing on designing and building critical technology solutions for Chase AI components like Chase Agent, Agent Operating Memory, Domain Agents, Agentic Experience Service, and Assurance. The role involves creating secure, high-quality production code, executing software solutions, producing architecture and design artifacts, and troubleshooting complex problems. Key responsibilities include adopting new technologies for agentic solutions, collaborating with cross-functional teams, leading code reviews, mentoring junior engineers, and ensuring compliance with security, privacy, and regulatory requirements. Requires hands-on experience building agentic systems using LLMs/SLMs, proficiency in Java/Python, experience with Spring AI or Python frameworks, AWS, and understanding of LLM patterns like function calling, RAG, and safety guardrails.

What you'd actually do

  1. Create secure, high-quality production code and maintain algorithms that run synchronously with appropriate systems.
  2. Execute software solutions, design, development, and technical troubleshooting, thinking beyond routine approaches to solve complex problems.
  3. Produce architecture and design artifacts for complex applications, ensuring design constraints are met by software code development.
  4. Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets to drive continuous improvement of software applications and systems.
  5. Proactively identify hidden problems and patterns in data, using insights to drive improvements in coding hygiene and system architecture.

Skills

Required

  • Hands-on experience building agentic systems using LLMs/SLMs
  • 5+ years of software engineering experience
  • 2+ years building complex scalable applications or agentic systems
  • Experience setting up and maintaining MCP servers and building MCP-compatible tools/adapters
  • Proficient in coding in one or more languages: Java, Python
  • Proficiency building production services with either Spring AI and the Spring ecosystem (Spring Boot, Spring Security, Spring Cloud), or Python (FastAPI/Flask), with typed contracts, testing, and packaging.
  • Solid AWS background with working knowledge of ECS or EKS, containerization (Docker), and CI/CD (GitHub Actions/Jenkins/CodeBuild).
  • Strong API design skills (REST/OpenAPI; gRPC)
  • Familiarity with observability stacks (e.g., Splunk, CloudWatch, Prometheus/Grafana, OpenTelemetry).
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails.
  • Strong testing culture: unit/integration tests, load tests, and evaluation datasets for agents.
  • Excellent communication and cross-functional collaboration skills.
  • Experience with agile methodologies and working in fast-paced, iterative development environments.

Nice to have

  • Expertise with distributed orchestration patterns for LLM applications (graph-based flows, retries, fallbacks, guardrails) and secure integration with enterprise tools and data.
  • Experience with safe rollout strategies (shadowing, A/B testing, progressive exposure), human-in-the-loop review, and continuous evaluation for quality and safety, including canary rollouts.
  • Knowledge of API gateways, service mesh, and multi-region high availability and disaster recovery for mission-critical services.
  • Familiarity with data privacy, security best practices, and regulatory compliance in financial services.
  • Experience with performance optimization, scalability, and reliability engineering for large-scale systems.
  • Ability to evaluate and integrate third-party tools, libraries, and frameworks to accelerate development.
  • Demonstrated leadership in technical communities, open source contributions, or industry forums.

What the JD emphasized

  • Hands-on experience building agentic systems using LLMs/SLMs
  • 2+ years building complex scalable applications or agentic systems
  • Proficiency building production services with either Spring AI and the Spring ecosystem (Spring Boot, Spring Security, Spring Cloud), or Python (FastAPI/Flask), with typed contracts, testing, and packaging.
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails.
  • Strong testing culture: unit/integration tests, load tests, and evaluation datasets for agents.

Other signals

  • building agentic systems using LLMs/SLMs
  • building production services with Spring AI
  • LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails