AI Infrastructure Engineer

AMD AMD · Semiconductors · San Jose, CA · Engineering

Seeking a DevOps/Platform Engineer to build and operate large-scale GPU compute infrastructure for AI/ML workloads, focusing on Kubernetes, orchestration systems, and developer-facing platform features.

What you'd actually do

  1. Build and extend platform capabilities to enable new classes of workloads (e.g., interactive development pods, CI pipelines, inference services, benchmarking jobs).
  2. Design and operate scalable orchestration systems using Kubernetes across both on-prem and multi-cloud environments.
  3. Develop platform features such as secret management, configuration management, and deployment automation for customers.
  4. Partner with development teams to extend the GPU developer platform with features, APIs, templates, and self-service workflows that streamline job orchestration and environment management.
  5. Manage service lifecycle within Kubernetes using Helm and GitOps workflows (e.g., ArgoCD or Flux).

Skills

Required

  • Kubernetes
  • container orchestration
  • platform features
  • developer-facing platforms

Nice to have

  • storage engineering
  • network engineering
  • Kubernetes
  • CSI drivers
  • dynamic provisioning
  • CNI plugins
  • network policy
  • Infrastructure as Code
  • Terraform
  • HPC
  • Slurm
  • GPU-based compute systems
  • ML/AI workloads
  • monitoring
  • observability
  • Prometheus
  • Grafana
  • Loki
  • machine learning frameworks
  • PyTorch
  • vLLM
  • SGLang

What the JD emphasized

  • 5+ years of experience in DevOps, Platform, or Infrastructure Engineering
  • Deep hands-on experience with Kubernetes and container orchestration at scale
  • Proven ability to design and deliver platform features that serve internal customers or developer teams
  • Experience building developer-facing platforms or internal developer portals (e.g.custom workflow tooling)

Other signals

  • GPU compute infrastructure
  • AI and ML workloads
  • Kubernetes
  • developer platform