Sr. Lead Software Engineer - Aiml Platforms

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Corporate Sector

Sr. Lead Software Engineer for AI/ML Platforms at JPMorgan Chase, focusing on building and operating foundational cloud infrastructure (AWS, Kubernetes, Terraform) to support AI/ML workloads, including model training and serving. The role involves technical leadership, platform reliability, scalability, and automation, with collaboration across teams to accelerate AI/ML capabilities and enable faster deployments.

What you'd actually do

  1. Architect and implement scalable, production-grade infrastructure on AWS using Kubernetes (EKS) to support AI/ML workloads across the enterprise
  2. Lead the design and development of infrastructure-as-code solutions using Terraform, ensuring repeatable, auditable, and automated environment provisioning
  3. Drive the installation, configuration, and lifecycle management of AI/ML platform components, ensuring high availability and operational resilience
  4. Partner with data science, machine learning, and product teams to define platform requirements and translate them into robust engineering solutions
  5. Establish and enforce engineering best practices, coding standards, and security controls across the platform infrastructure

Skills

Required

  • software engineering concepts
  • Terraform
  • Kubernetes
  • AWS
  • DevOps
  • platform engineering principles
  • CI/CD
  • observability
  • automated testing

Nice to have

  • Go
  • Python
  • MLOps frameworks
  • Kubeflow
  • MLflow
  • service mesh technologies
  • cloud networking patterns
  • container security best practices
  • multi-cloud
  • hybrid cloud architectures

What the JD emphasized

  • 5+ years applied experience
  • infrastructure-as-code tooling, specifically Terraform
  • Kubernetes clusters, with specific depth in AWS Elastic Kubernetes Service (EKS)
  • architect and operate cloud-native infrastructure on AWS
  • supporting or building platforms for AI/ML workloads, including model training, serving, or experimentation environments

Other signals

  • enables data scientists and machine learning engineers to develop, train, and deploy intelligent solutions
  • accelerate the firm's AI/ML capabilities
  • faster experimentation and production-grade deployments