Senior Lead AI Engineer (mlx, Agentic Ai, Gen AI Platform Services)

Capital One Capital One · Banking · McLean, VA +4

Senior Lead AI Engineer role focused on building and deploying Gen AI platform services, including agentic AI, ML software components, distributed training, inference, orchestration, and observability. The role involves leveraging open-source and SaaS AI/ML technologies, optimizing large-scale production ML systems, and contributing to the technical vision and roadmap.

What you'd actually do

  1. Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
  2. Design, develop, test and support ML software components including distributed model training and inference, model orchestration and observability, etc.
  3. Leverage a broad stack of Open Source and SaaS AI/ML technologies such as kubernetes, kubeflow pipelines, ray, polars and more
  4. Invent and introduce state-of-the-art ETL and ML optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production ML systems.
  5. Contribute to the technical vision and the long term roadmap of ML systems at Capital One.

Skills

Required

  • Python
  • Go
  • Scala
  • Java
  • Computer Science
  • AI
  • Electrical Engineering
  • Computer Engineering

Nice to have

  • AWS
  • Google Cloud
  • Azure
  • private cloud
  • LLM Inference
  • Similarity Search
  • VectorDBs
  • Guardrails
  • Memory
  • C++
  • C#
  • Golang
  • optimizing training and inference software
  • hardware utilization
  • latency
  • throughput
  • cost
  • AI research
  • AI systems
  • communication
  • presentation

What the JD emphasized

  • responsible and reliable AI systems
  • scalable, high-performance AI infrastructure
  • responsible and scalable ways
  • deploying scalable and responsible AI solutions

Other signals

  • Gen AI platform Services
  • Agentic AI
  • ML software components
  • distributed model training and inference
  • model orchestration and observability