Senior Systems Software Engineer - GPU Performance at Scale

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA +4 · Remote

Senior Systems Software Engineer focused on GPU performance at scale for AI workloads, involving collaboration with various hardware and software teams to optimize large-scale computing platforms and deliver insights into AI workload performance.

What you'd actually do

  1. Lead the implementation of performance practices in large-scale GPU infrastructure, delivering powerful tools, methodologies, and flows to validate and improve multiple datacenter products concurrently.
  2. Align next-generation AI workloads with next-generation datacenter builds for NVIDIA GPUs, CPUs, and networking hardware. Engage early with HW/FW/SW/platform internal and customer teams.
  3. Develop engineering solutions that provide continuous insights into the performance of AI workloads in evolving environments, generating swift insights into improvements and regressions.
  4. Decompose high-complexity performance or stability issues into minimal reproduction cases, working towards identifying the root cause.
  5. Participate in collaborations with various SW and FW teams (BMC/SBIOS/OS/drivers, etc.) to develop outstanding methods and tools. Analyze, debug, and resolve critical firmware and software issues to achieve the highest AI workload performance at scale.

Skills

Required

  • Proven understanding of accelerated computing software stacks (CUDA).
  • Experience with modern cloud and container-based enterprise computing architectures, with Slurm preferred.
  • Strong programming and scripting experience in C/C++/Python/Bash.
  • Deep expertise in systems architecture and the impact of various components on performance.
  • Experience with container technology and Linux-based OSes, with Docker preferred.
  • Experience supporting high-performance computing or deep learning in engineering or academic research communities.
  • Strong teamwork and communication skills, coupled with results-focused analytical abilities.
  • BS in Engineering, Mathematics, Physics, or Computer Science (or equivalent experience); MS or PhD desirable with 8+ years of applicable experience.

Nice to have

  • End-to-end GPU performance engineering from the profiler to systems analysis.
  • Linux systems programming and optimization experience.
  • Exposure to virtualization techniques and cloud platform solutions.
  • Experience with scheduling and resource management systems.
  • Experience with large-scale HPC environments.

What the JD emphasized

  • GPU Performance at Scale
  • AI workloads
  • large-scale GPU infrastructure
  • next-generation AI workloads
  • AI workload performance at scale

Other signals

  • GPU performance at scale
  • AI workloads
  • datacenter products
  • HPC, OS, CPU, GPU compute, and systems specialists