Director - Applied AI ML (software Engineering/data & Agentic Systems)

JPMorgan Chase JPMorgan Chase · Banking · Bengaluru, Karnataka, India · Commercial & Investment Bank

Director level role focused on building and scaling production-grade agentic GenAI workflows and RAG systems within an enterprise setting. This involves establishing reusable frameworks, shared components, and best practices for the end-to-end lifecycle, including data pipelines, orchestration, evaluation, monitoring, and governance. The role requires strong software and data engineering expertise, cloud-native experience, and the ability to advise senior stakeholders on technical feasibility and strategy.

What you'd actually do

  1. Establish and promote a library of reusable GenAI/ML engineering assets, including reference implementations, standardized templates/SDKs, shared RAG components (ingestion, chunking, embedding, indexing, retrieval), and deployment patterns.
  2. Lead the creation of shared tools and platforms that streamline the end-to-end lifecycle for GenAI applications, including data pipelines, orchestration, evaluation, monitoring/telemetry, and release governance.
  3. Build and operationalize agentic GenAI workflows (planning/execution patterns, tool calling, state management, retries) with appropriate guardrails, permissions, and observability.
  4. Design and implement Generative AI evaluation and feedback loops (offline test suites, human review where needed, continuous evaluation, telemetry-based monitoring, regression gating in CI/CD).
  5. Advise on strategy and development across multiple GenAI products, applications, and technology portfolios—focusing on common capabilities that scale across teams rather than one-off solutions.

Skills

Required

  • 10+ years of applied experience in software engineering and/or data engineering
  • Python, Java, or similar languages
  • building production distributed systems end-to-end
  • designing and delivering GenAI systems to production
  • RAG (embeddings, retrieval/indexing)
  • evaluation/monitoring
  • building agentic workflows (tool calling, orchestration, state, retries, guardrails)
  • frameworks such as LangChain/LangGraph or equivalent
  • data architecture and engineering (lakehouse/data platform concepts)
  • data quality, lineage/metadata, idempotent pipelines, backfills, and governance/PII controls relevant to GenAI
  • cloud-native experience on AWS
  • secure deployment and operations (e.g., EKS and/or managed services)
  • cost/latency management
  • translate complex technical issues to senior stakeholders
  • excellent communication
  • attention to detail
  • follow-through

Nice to have

  • Bachelor’s/Master’s degree in Computer Science (or equivalent practical experience)
  • Working knowledge of PyTorch or TensorFlow
  • Experience with ML/GenAI evaluation automation and CI/CD quality gates

What the JD emphasized

  • production distributed systems end-to-end
  • delivering GenAI systems to production
  • agentic workflows
  • evaluation/monitoring
  • data architecture and engineering
  • governance/PII controls relevant to GenAI
  • cloud-native experience on AWS
  • secure deployment and operations
  • cost/latency management
  • translate complex technical issues to senior stakeholders

Other signals

  • building production-grade agentic workflows
  • RAG-based systems
  • reusable frameworks
  • shared components
  • best practices
  • GenAI engineering trends
  • GenAI/ML engineering assets
  • reference implementations
  • standardized templates/SDKs
  • shared RAG components
  • deployment patterns
  • shared tools and platforms
  • end-to-end lifecycle for GenAI applications
  • data pipelines
  • orchestration
  • evaluation
  • monitoring/telemetry
  • release governance
  • agentic GenAI workflows
  • planning/execution patterns
  • tool calling
  • state management
  • retries
  • guardrails
  • permissions
  • observability
  • Generative AI evaluation and feedback loops
  • offline test suites
  • human review
  • continuous evaluation
  • telemetry-based monitoring
  • regression gating in CI/CD
  • strategy and development across multiple GenAI products
  • applications
  • technology portfolios
  • common capabilities that scale across teams
  • technical feasibility and business value for GenAI use cases
  • build-vs-buy decisions
  • pragmatic solution designs
  • firmwide AI/ML stakeholders
  • standards
  • interoperability
  • adoption
  • reuse of shared frameworks
  • complex technical issues and tradeoffs
  • quality vs latency vs cost
  • evaluation design
  • governance
  • security
  • senior leadership
  • strategic decisions
  • influence across business, product, and technology teams
  • senior stakeholder relationships
  • mentor engineers and practitioners
  • raise engineering and delivery standards
  • applied experience in software engineering and/or data engineering
  • Python, Java, or similar languages
  • building production distributed systems end-to-end
  • designing and delivering GenAI systems to production
  • RAG (embeddings, retrieval/indexing)
  • evaluation/monitoring
  • building agentic workflows
  • tool calling
  • orchestration
  • state
  • retries
  • guardrails
  • frameworks such as LangChain/LangGraph or equivalent
  • data architecture and engineering
  • lakehouse/data platform concepts
  • data quality
  • lineage/metadata
  • idempotent pipelines
  • backfills
  • governance/PII controls relevant to GenAI
  • cloud-native experience on AWS
  • secure deployment and operations
  • EKS and/or managed services
  • cost/latency management
  • translate complex technical issues to senior stakeholders
  • excellent communication
  • attention to detail
  • follow-through
  • ML/GenAI evaluation automation
  • CI/CD quality gates