Lead Software Engineer

JPMorgan Chase JPMorgan Chase · Banking · Columbus, OH +1 · Consumer & Community Banking

Lead Software Engineer role focused on designing and building critical technology solutions for Chase AI components, including agentic systems, using LLMs/SLMs. Requires strong software engineering experience, proficiency in Java/Python, cloud technologies (AWS), API design, and practical understanding of LLM patterns like function calling, RAG, and guardrails. The role emphasizes building secure, high-quality production code and contributing to agentic solutions.

What you'd actually do

  1. Execute software solutions, design, development, and technical troubleshooting, thinking beyond routine approaches to solve complex problems.
  2. Create secure, high-quality production code and maintain algorithms that run synchronously with appropriate systems.
  3. Produce architecture and design artifacts for complex applications, ensuring design constraints are met by software code development.
  4. Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets to drive continuous improvement of software applications and systems.
  5. Proactively identify hidden problems and patterns in data, using insights to drive improvements in coding hygiene and system architecture.

Skills

Required

  • 5+ years of software engineering experience
  • 2+ years building complex scalable applications or agentic systems
  • Hands-on experience building agentic systems using LLMs/SLMs
  • Experience setting up and maintaining MCP servers and building MCP-compatible tools/adapters
  • Proficient in coding in one or more languages: Java, Python
  • Proficiency building production services with either Spring AI and the Spring ecosystem (Spring Boot, Spring Security, Spring Cloud), or Python (FastAPI/Flask)
  • Solid AWS background with working knowledge of ECS or EKS, containerization (Docker), and CI/CD (GitHub Actions/Jenkins/CodeBuild)
  • Strong API design skills (REST/OpenAPI; gRPC)
  • familiarity with observability stacks (e.g., Splunk, CloudWatch, Prometheus/Grafana, OpenTelemetry)
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails
  • Strong testing culture: unit/integration tests, load tests, and evaluation datasets for agents
  • Excellent communication and cross-functional collaboration skills
  • Experience with agile methodologies

Nice to have

  • Expertise with distributed orchestration patterns for LLM applications (graph-based flows, retries, fallbacks, guardrails)
  • secure integration with enterprise tools and data
  • Experience with safe rollout strategies (shadowing, A/B testing, progressive exposure), human-in-the-loop review, and continuous evaluation for quality and safety, including canary rollouts
  • Knowledge of API gateways, service mesh, and multi-region high availability and disaster recovery for mission-critical services
  • Familiarity with data privacy, security best practices, and regulatory compliance in financial services
  • Experience with performance optimization, scalability, and reliability engineering for large-scale systems
  • Ability to evaluate and integrate third-party tools, libraries, and frameworks to accelerate development
  • Demonstrated leadership in technical communities, open source contributions, or industry forums

What the JD emphasized

  • building complex scalable applications or agentic systems
  • Hands-on experience building agentic systems using LLMs/SLMs
  • agentic systems
  • agentic solutions

Other signals

  • building complex scalable applications or agentic systems
  • Hands-on experience building agentic systems using LLMs/SLMs
  • Proficient in coding in one or more languages: Java, Python
  • Proficiency building production services with either Spring AI and the Spring ecosystem (Spring Boot, Spring Security, Spring Cloud), or Python (FastAPI/Flask)
  • Solid AWS background with working knowledge of ECS or EKS, containerization (Docker), and CI/CD (GitHub Actions/Jenkins/CodeBuild)
  • Strong API design skills (REST/OpenAPI; gRPC and familiarity with observability stacks (e.g., Splunk, CloudWatch, Prometheus/Grafana, OpenTelemetry)
  • Practical understanding of LLM patterns: function calling/tools, RAG, prompt management, context windows, token budgeting, and safety guardrails
  • Strong testing culture: unit/integration tests, load tests, and evaluation datasets for agents