Software Engineer III - Ai/ml, Java/python, React

JPMorgan Chase JPMorgan Chase · Banking · Mumbai, Maharashtra, India · Commercial & Investment Bank

Software Engineer III at JPMorgan Chase in Mumbai, India, focused on building and operating resilient backend services and APIs that power enterprise workflows and AI-enabled capabilities. The role involves integrating LLM/prompt capabilities into production services with guardrails, implementing retrieval patterns (RAG) and orchestration workflows, and building user experiences for AI-powered applications. Requires strong software engineering experience in Java/Python, distributed systems, cloud-native development (AWS), and CI/CD, with preferred experience in AI/LLM integration, vector search, and RAG.

What you'd actually do

  1. Build and operate resilient backend services and APIs that power enterprise workflows and AI-enabled capabilities.
  2. Integrate LLM/prompt capabilities into production services with guardrails, fallback paths, response validation, and clear auditability.
  3. Design service interfaces with strong API contract management, versioning, and integration patterns.
  4. Implement retrieval patterns (e.g., RAG) and orchestration workflows using LangChain or similar frameworks, connecting models to approved enterprise data sources and APIs (subject to firm-approved tooling).
  5. Implement and optimize vector search/embedding solutions (e.g., pgvector or equivalent) including indexing strategy, metadata filtering, hybrid search, and production scaling (subject to firm-approved tooling).

Skills

Required

  • BS/BA degree in Computer Science, Engineering, Information Systems, or equivalent experience.
  • 3+ years of hands-on software engineering experience delivering production systems.
  • Strong experience building backend services and APIs in Java and/or Python.
  • Solid foundation in distributed systems, service design, and API contract management.
  • Experience with cloud-native development and familiarity with AWS services.
  • Experience with CI/CD, release automation, and modern deployment practices.
  • Proficiency in testing practices and production readiness (quality, reliability, operational support).
  • Strong collaboration and communication skills; ability to convert business intent into executable technical plans.

Nice to have

  • 1+ years integrating AI/LLM functionality into enterprise applications, including guardrails and monitoring.
  • Experience with vector search/embeddings and retrieval-enabled architectures (RAG).
  • Experience with observability platforms and SRE-style operational practices.
  • Experience with secure SDLC practices and governance expectations.
  • Experience in financial services, technology risk, controls, or audit-oriented environments.
  • Relevant cloud certifications.

What the JD emphasized

  • production-grade applications
  • enterprise scale
  • LLM-enabled workflows
  • production services
  • production systems
  • production readiness

Other signals

  • building resilient platforms
  • reliable services
  • prompt-enabled workflow automation
  • LLM-enabled workflows into core systems
  • production-grade applications
  • enterprise scale