Sr Lead Software Engineer - Aws - Lead Ai/ml Platform Engineer

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Corporate Sector

Senior Lead Software Engineer responsible for architecting, building, and owning the AI/ML platform infrastructure for model deployment at scale within JPMorgan Chase. This role focuses on the control plane, APIs, monitoring, and deployment infrastructure, requiring end-to-end ownership, architectural decision-making, and client engagement. The position also involves driving the adoption and governance of AI-assisted engineering practices and ensuring responsible AI use.

What you'd actually do

  1. Drive architectural vision for platform components: control plane integration, multi-region deployment, and disaster recovery
  2. Design and implement APIs for retraining, scheduling, endpoint deployment, and autoscaling
  3. Build infrastructure for seamless integration across control plane and client accounts
  4. Engage directly with US-based clients — requirements, strategic solutioning, and debugging
  5. Make independent architectural decisions and own technical tradeoffs with minimal oversight

Skills

Required

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Proficiency in architecting software solutions at scale
  • Self-directed and autonomous
  • Strong client-facing communication skills, effective across time zones in a distributed team
  • Deep knowledge of AWS and cloud-based infrastructure
  • Track record building resilient, production-grade platform
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment
  • Strong understanding of responsible AI use in engineering workflows

Nice to have

  • Comfort with ambiguity and greenfield architecture where no existing playbook applies
  • Production experience with Kubernetes / EKS at scale
  • Hands-on experience with AWS Sagemaker for model training and deployment
  • Strong Golang skills in the context of infrastructure or platform services
  • Deep understanding of networking — VPCs, DNS, cross-account connectivity
  • Practical experience with LLMs — deployment, inference, or integration
  • Track record delivering Terraform across multi-account, multi-region environments

What the JD emphasized

  • owning technical direction
  • making architectural decisions with real production consequences
  • owning problems end-to-end
  • making hard tradeoffs
  • shipping systems that other engineers build on top of
  • Track record building resilient, production-grade platform
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment
  • Strong understanding of responsible AI use in engineering workflows

Other signals

  • owns the infrastructure that makes model deployment work at scale
  • build the control plane, APIs, monitoring, and deployment infrastructure
  • shipping systems that other engineers build on top of
  • architectural vision for platform components: control plane integration, multi-region deployment, and disaster recovery
  • Design and implement APIs for retraining, scheduling, endpoint deployment, and autoscaling
  • Build infrastructure for seamless integration across control plane and client accounts
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment
  • Strong understanding of responsible AI use in engineering workflows