GPU Performance Engineer - Neural Reconstruction

NVIDIA NVIDIA · Semiconductors · CA +5 · Remote

GPU Performance Engineer focused on optimizing neural reconstruction and Gaussian Splatting workloads. This role involves profiling, identifying bottlenecks, and improving performance in CUDA, PyTorch, and C++ for training and rendering, while ensuring reconstruction quality is maintained. It requires strong programming, GPU optimization, and performance analysis skills, with collaboration across research and engineering teams.

What you'd actually do

  1. Profile end-to-end neural reconstruction workflows and identify bottlenecks across data loading, initialization, training, rendering, evaluation, and export.
  2. Improve CUDA and PyTorch performance for Gaussian Splatting and neural reconstruction workloads, including camera/lidar data, multiview batching, large-scene rendering, and memory-sensitive training paths.
  3. Analyze GPU performance using tools such as Nsight Systems, Nsight Compute, NVTX, PyTorch Profiler, CUDA events, and benchmark dashboards.
  4. Optimize sparse and irregular rendering workloads, including tile-level masking/culling, sparse gradients, batching, and multi-GPU execution.
  5. Translate high-impact Python, NumPy, or PyTorch bottlenecks into efficient CUDA/C++ or PyTorch-native implementations when appropriate.

Skills

Required

  • BS, MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, Applied Math, Robotics, Computer Vision, Machine Learning, or a related field (or equivalent experience) with 12+ years of experience.
  • Strong programming skills in Python and C++
  • Hands-on experience with PyTorch or a similar tensor/autograd framework.
  • Experience optimizing GPU-accelerated workloads using CUDA, C++/CUDA extensions, or related GPU programming approaches.
  • Practical experience with profiling and performance analysis, including root-causing CPU/GPU bottlenecks, synchronization overhead, memory pressure, kernel launch overhead, and framework-level inefficiencies.
  • Ability to develop benchmarks and validate that optimizations preserve correctness, numerical behavior, and user-visible quality.
  • Strong communication skills, including the ability to explain performance tradeoffs, risks, and results to research and engineering partners.

Nice to have

  • Experience with Gaussian Splatting, NeRF, differentiable rendering, rasterization, neural rendering, SLAM, 3D reconstruction, or robotics/autonomous-vehicle perception pipelines.
  • Deep CUDA performance experience, including memory access patterns, shared memory, atomics, occupancy, launch configuration, synchronization, and numerical stability.
  • Experience optimizing PyTorch workloads with custom operators, fused kernels, sparse tensors, distributed training, or distributed rendering.
  • Familiarity with camera and lidar geometry, projection models, calibration, rolling shutter, depth rendering, or multi-sensor reconstruction.
  • Experience improving large production ML systems where quality metrics, training speed, memory footprint, and developer velocity must be balanced.

What the JD emphasized

  • 12+ years of experience
  • Strong programming skills in Python and C++!
  • Hands-on experience with PyTorch or a similar tensor/autograd framework.
  • Experience optimizing GPU-accelerated workloads using CUDA, C++/CUDA extensions, or related GPU programming approaches.
  • Practical experience with profiling and performance analysis, including root-causing CPU/GPU bottlenecks, synchronization overhead, memory pressure, kernel launch overhead, and framework-level inefficiencies.
  • Ability to develop benchmarks and validate that optimizations preserve correctness, numerical behavior, and user-visible quality.

Other signals

  • optimize training and rendering workflows
  • improve CUDA and PyTorch performance
  • GPU performance analysis
  • optimize sparse and irregular rendering workloads
  • translate bottlenecks into efficient implementations
  • validate performance improvements preserve reconstruction quality
  • build repeatable benchmarks and regression tests
  • collaborate with researchers, CUDA engineers, ML engineers, and production teams