Compiler Engineer, AI Inference- New College Grad 2026

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA

NVIDIA is seeking AI Compiler Engineers to optimize kernel generation and computational graph optimizations for AI workloads (inference and training) on next-generation GPUs, focusing on performance and scaling for datacenter deployments. This role involves hardware/software co-design and advancing the state-of-the-art in AI compilation.

What you'd actually do

  1. Participating in hands-on development focusing on kernel generation and computational graph optimizations for next-generation NVIDIA GPUs.
  2. Solve complex compilation problems for AI workloads (both inference and training) and successfully transition these breakthroughs into enterprise and consumer products.
  3. Partner with leading experts across our software, hardware, and research divisions to architect and co-design future silicon.
  4. Participating in the advancement and optimization of datacenter-scale AI workload deployments.

Skills

Required

  • BS or MS in Computer Science, Computer Engineering, or a related field (or equivalent experience).
  • Experience specializing in compiler optimizations, synthesis, and placement.
  • Demonstrated, hands-on experience working with MLIR.
  • Exceptional C/C++ and Python programming and software design skills, including rigorous debugging, performance analysis, and test design.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively in a dynamic, fast-paced, and product-oriented environment.

Nice to have

  • PhD is strongly preferred.
  • Hands-on experience implementing complex AI workloads on CPU, GPU, and/or custom AI accelerator architectures.
  • Deep understanding of Large Language Model (LLM) inference and its profound implications on computer architecture.
  • Demonstrated understanding in the designing and architecting of comprehensive compiler frameworks from the ground up.

What the JD emphasized

  • AI workloads
  • inference
  • training
  • next-generation NVIDIA GPUs
  • datacenter-scale AI workload deployments
  • MLIR Knowledge
  • LLM Knowledge
  • compiler frameworks

Other signals

  • AI inference and training workloads
  • next-generation NVIDIA GPUs
  • datacenter-scale AI workload deployments