Senior Associate -applied AI Data Scientist

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Asset & Wealth Management

Senior Associate role focused on building and scaling production LLM agents for finance workflows, involving RAG, tool use, multi-step reasoning, evaluation frameworks, guardrails, and MLOps practices on cloud platforms.

What you'd actually do

  1. Build production LLM agents for finance workflows using techniques such as retrieval‑augmented generation (RAG), tool use, and multi‑step reasoning.
  2. Develop robust data and inference pipelines in Python and SQL; integrate agents with APIs, microservices, and BI applications.
  3. Implement evaluation frameworks and guardrails: offline and online tests, automatic metrics (factuality, grounding, hallucination rate), human‑in‑the‑loop reviews, red‑team testing, and observability.
  4. Optimize for scale, latency, and cost across cloud environments; leverage vector databases and embeddings for efficient retrieval.
  5. Partner with Finance, Product, and Engineering to identify high‑value use cases; translate ambiguous problems into measurable outcomes.

Skills

Required

  • Python
  • SQL
  • RAG
  • prompt engineering
  • fine-tuning
  • function/tool calling
  • vector stores
  • cloud platforms (AWS, Azure, or GCP)
  • modern data stacks (Databricks or Snowflake)
  • LLM frameworks and orchestration (LangChain or LlamaIndex)
  • REST/GraphQL API design
  • analytics
  • applied statistics
  • experiment design
  • MLOps practices

Nice to have

  • multi-agent systems
  • autonomous workflows
  • task planners
  • PySpark
  • distributed compute
  • model safety
  • bias
  • privacy techniques
  • model risk management
  • governance
  • observability tools (logging, tracing, telemetry)
  • A/B testing
  • BI/reporting integration
  • workflow tools
  • Tableau
  • GPUs/accelerators
  • containerization
  • infrastructure-as-code

What the JD emphasized

  • 6+ years in data/ML roles, including 3+ years building and operating production ML applications
  • hands‑on experience with LLMs
  • Experience building multi‑agent systems, autonomous workflows, or task planners

Other signals

  • building production LLM agents
  • design, deploy, and scale LLM agents
  • implement evaluation frameworks and guardrails
  • optimize for scale, latency, and cost
  • apply ML engineering and MLOps practices