Principal Engineer, Cuda Umd - GPU Kernel Scheduling

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA

This role focuses on the CUDA Driver, a core component for accelerating general-purpose computation on NVIDIA GPUs. The engineer will architect and implement features, improve scheduling of AI/ML workloads on GPUs, and extend CUDA programming models. The role requires strong C/C++ skills, deep understanding of device drivers, and experience with operating system interfaces and multithreaded programming. Prior experience with parallel computing, CUDA, and kernel mode development are preferred.

What you'd actually do

  1. Evangelize, architect, and implement new features
  2. Coordinate and drive development efforts across multiple teams
  3. Help define forward-looking improvements to the CUDA APIs and programming model
  4. Extend important CUDA programming models and functionality such as CUDA Graphs
  5. Explore ways to use Graphs to improve the scheduling of AI/ML workloads on our GPUS to be more efficient and faster.

Skills

Required

  • BS or MS degree in Computer Science, Electrical Engineering​ or related field (or equivalent experience)
  • Strong C and C++ programming skills
  • Minimum of 15+ years of related development experience
  • Experience driving projects across multiple teams
  • Experience working with large codebases
  • Background with operating system interfaces for threads, process control, and virtual memory
  • Experience writing and debugging multithreaded programs
  • Good written communication as well as presentation skills

Nice to have

  • Prior experience with parallel computing - preferably writing CUDA Programs or Libraries that use CUDA
  • Understanding of system level architecture, such as interconnects, memory hierarchy, interrupts, and memory-mapped IO
  • Knowledge of memory coherence and consistency models
  • Background with kernel mode development
  • Experience with Linux Systems Software development as well as experience maintaining and extending programming models or higher-level language support for similar environments

What the JD emphasized

  • Minimum of 15+ years of related development experience