Principal Software Engineer - AI Foundations

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Corporate Sector

Principal Software Engineer focused on building and scaling AI Foundations at JPMorgan Chase. This role involves designing, building, and deploying AI-enabled applications and services, with a strong emphasis on MLOps, agentic workflows, and next-generation training techniques. The engineer will contribute to reusable platform components and influence stakeholders to drive adoption of AI-assisted development practices.

What you'd actually do

  1. Design, build, and troubleshoot AI-enabled applications and AI services, delivering creative, scalable solutions.
  2. Design and implement end-to-end MLOps capabilities including data/model versioning, reproducible training pipelines, CI/CD for models, deployment patterns, and continuous evaluation/monitoring.
  3. Contribute to next-generation training techniques (distributed fine-tuning, RLHF/DPO-style workflows, synthetic data generation, and automated evaluation) and productize them into reusable platform primitives.
  4. Architects and governs agentic AI-enabled engineering workflows (using enterprise-authorized tools within the work environment) to improve delivery speed, code quality, and operational outcomes at scale (e.g., AI-driven PR review assistance, test generation/maintenance, release readiness checks, incident triage and root-cause acceleration), while defining guardrails for validation, security, resiliency, and reuse across teams.
  5. Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale.

Skills

Required

  • Expert proficiency in one or more programming languages (e.g., Python, Java, Scala, Go) with strong code quality, testing, and debugging practices.
  • Demonstrated experience designing and leading adoption of agentic AI-enabled development practices (using enterprise-authorized tools within the work environment) across teams, including setting standards for human-in-the-loop validation, auditability/traceability of changes, and secure handling of sensitive data.
  • Strong understanding of responsible AI use and control expectations in engineering workflows, including security/resiliency implications, data sensitivity, and risk-based governance; ability to influence senior technical leaders on safe scaling patterns and reuse.
  • Proven ability to design and operate ML/LLM platforms: reproducible training pipelines, experiment tracking, model/data versioning, and continuous evaluation.
  • Practical cloud-native experience (containers, orchestration, IaC, observability) and experience operating production systems with clear SLOs.
  • Experience applying new methods to solve complex technology problems across one or more technical disciplines (platform engineering, ML systems, data engineering, distributed systems).
  • Strong communication skills: able to present to and influence senior leaders/executives, translating complex technical topics into clear decisions and trade-offs.
  • Strong understanding of business outcomes and product delivery, and ability to align platform roadmaps to measurable impact.

Nice to have

  • Practical experience with distributed compute and scalable model training/fine-tuning (e.g., Ray and/or comparable distributed frameworks), including performance, cost, and reliability trade-offs.
  • Experience building model development platforms for LLMs/agentic systems (fine-tuning, evaluation harnesses, retrieval/tooling integration, prompt/agent testing).
  • Experience with modern MLOps toolchains (CI/CD for models, model registries, feature/data stores, governance workflows) and production ML operations.
  • Background in LLM evaluation, benchmarking, red-teaming, and quality measurement (offline + online), including experimentation and A/B testing.
  • Experience designing multi-tenant platforms, reusable frameworks, and developer self-service capabilities at enterprise scale.
  • Strong security-by-design experience for ML systems (secrets, access control, data handling, supply chain controls) and resiliency engineering.

What the JD emphasized

  • AI-enabled applications and AI services
  • MLOps capabilities
  • next-generation training techniques
  • agentic AI-enabled engineering workflows
  • AI-assisted development

Other signals

  • AI-enabled applications and AI services
  • MLOps capabilities
  • next-generation training techniques
  • agentic AI-enabled engineering workflows
  • AI-assisted development