NVIDIA is seeking a highly skilled Senior Performance Engineer to join our Performance and R&D organizations. In this role, you will help build and evolve systems that support performance analysis, telemetry, and optimization for large-scale GPU- and CPU-based clusters used in AI and high-performance computing environments. You will work closely with hardware, networking, firmware, and software teams to collect, analyze, and interpret performance data from live systems. This is a fast-paced R&D environment where system behavior and requirements evolve rapidly, requiring adaptable engineering solutions and strong analytical thinking.
What you’ll be doing:
- Profile, benchmark, and analyze AI and HPC workloads on GPU and CPU clusters
- Explore performance characteristics of high-performance networking and collective communications (e.g., NCCL, RDMA, MPI, RoCE)
- Identify performance bottlenecks across networking, compute, memory, and system architecture
- Develop and enhance performance analysis, benchmarking, and diagnostic tools
- Define performance test plans and establish expectations for new technologies and platforms
- Collaborate across hardware, firmware, networking, systems, and software teams to provide actionable performance insights
- Support telemetry collection and data refinement efforts to enable accurate performance analysis
- Maintain high standards for data quality, reproducibility, and traceability of performance results
What we need to see:
- B.Sc. or M.Sc. in Computer Science, Computer Engineering, Software Engineering, or equivalent experience
- 5+ years of experience in performance analysis, systems engineering, or HPC/AI infrastructure
- Demonstrated expertise in performance analysis skills and methodologies
- Hands-on experience with high-performance networking (RDMA, MPI, NCCL, congestion control)
- Strong understanding of system performance metrics (latency, throughput, resource utilization)
- Exposure to hardware, firmware, or embedded telemetry environments
- Strong analytical, problem-solving, and communication skills
- Ability to work effectively in cross-functional, fast-paced R&D teams
Ways to stand out from the crowd:
- Knowledge of CUDA, NCCL internals, and congestion control algorithms
- Deep system-level understanding of CPU architectures, GPUs, HCAs, memory, and PCIe
- Experience with NVIDIA GPUs, CUDA, and deep learning frameworks such as PyTorch or TensorFlow
- Experience with cloud platforms
- Proficiency in Python; experience with Bash and C/C++ is a plus as well as a strong experience working in Linux environments