Lead Software Engineer(ai, Java)

JPMorgan Chase JPMorgan Chase · Banking · Hyderabad, Telangana, India · Consumer & Community Banking

Lead Software Engineer focused on building agentic AI systems, including multi-agent orchestration, tool-use chains, planning/reasoning loops, and memory architectures. Requires strong foundation in distributed systems, API design, microservices, event-driven architectures, and cloud platforms. Experience with LLMs, prompt engineering, fine-tuning, and evaluation is preferred.

What you'd actually do

  1. Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  2. Develops secure high-quality production code, and reviews and debugs code written by others
  3. Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
  4. Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture
  5. Leads communities of practice across Software Engineering to drive awareness and use of new and leading-edge technologies

Skills

Required

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • 3+ years focused on AI/ML systems
  • at least 2 years in a technical lead, staff, or principal-level individual contributor role
  • Deep hands-on experience building agentic AI systems
  • multi-agent orchestration
  • tool-use chains
  • planning/reasoning loops
  • memory architectures
  • Strong foundation in distributed systems
  • API design
  • microservices
  • event-driven architectures
  • Experience with cloud platforms (AWS, Azure, GCP)
  • containerization (Docker, Kubernetes)
  • CI/CD pipelines for ML/AI workloads
  • Expert in Java
  • Cockroach db
  • postgres sql
  • Casandra
  • Kafka
  • Spring
  • Spring Boot
  • Cloud foundry
  • Deep understanding of REST & SOAP Protocols
  • Understanding of software skills such as business analysis, development, maintenance, and software improvement
  • Pragmatism and the ability to strike the balance between the need for process versus the need to accelerate project delivery and not overburden teams with unnecessary administrative overhead
  • taking the ownership to drive business goal and leading from front
  • Knowledge of industry-wide technology trends and best practices

Nice to have

  • LLM Proficiency: Strong working knowledge of large language models (GPT-4+, Claude, Gemini, Llama, Mistral) including prompt engineering, fine-tuning, and evaluation methodologies
  • AI, Cloud Certifications

What the JD emphasized

  • 3+ years focused on AI/ML systems
  • at least 2 years in a technical lead, staff, or principal-level individual contributor role
  • Deep hands-on experience building agentic AI systems
  • multi-agent orchestration
  • tool-use chains
  • planning/reasoning loops
  • memory architectures
  • LLM Proficiency
  • prompt engineering
  • fine-tuning
  • evaluation methodologies

Other signals

  • building agentic AI systems
  • multi-agent orchestration
  • tool-use chains
  • planning/reasoning loops
  • memory architectures
  • LLM Proficiency
  • prompt engineering
  • fine-tuning
  • evaluation methodologies