Senior Radar Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA

Senior Radar Perception Engineer for NVIDIA's autonomous vehicle division, focusing on designing and productizing next-generation perception stacks using transformer-based foundation models, multi-sensor fusion, and radar-centric deep learning. The role involves applied research, model design, production implementation, and integration for L2-L4 autonomous driving functionalities.

What you'd actually do

  1. Architecture & Roadmap: Develop and improve the technical design, architecture, and roadmap for radar-based 3D obstacle perception to support end-to-end autonomous driving functionalities, leveraging state-of-the-art DNN and transformer-based architectures.
  2. Radar Perception Innovation: Conduct applied research on deep learning models to maximize the information content of radar point cloud data at every representation level. Tackle radar perception’s hardest problems: low and non-uniform angular resolution, multipath and ghost targets, micro-doppler signatures for small targets, and severe class imbalance. Explore weakly-supervised pretraining and improve radar perception via large auto-labeled datasets.
  3. Model Design & Fusion: Design and implement advanced 3D perception models utilizing radar inputs (ranging from low-level range-doppler/azimuth-elevation maps to sparse/dense point clouds) and multi-sensor fusion (camera, radar, lidar) for obstacle detection, tracking, and Bird’s-Eye-View (BEV) scene understanding.
  4. Sensor & Stack Integration: Drive radar sensor evaluation, selection, and layout optimization to support L2-L4 autonomous driving applications, ensuring seamless multi-sensor fusion.
  5. Production Deep Learning: Build efficient, production-grade deep learning models: define objectives with the team, select and prototype architectures, run experiments, and follow best practices for training and evaluation, using techniques such as large-scale radar pretraining, cross-modal distillation (e.g., lidar-to-radar), and parameter-efficient fine-tuning (e.g., LoRA).

Skills

Required

  • Deep learning
  • PyTorch
  • Python
  • C++
  • Radar signal processing
  • Multi-sensor fusion
  • Autonomous driving perception
  • Transformer architectures
  • DNNs
  • BEV networks

Nice to have

  • Radar-based or multi-modal perception solutions for autonomous driving or robotics at scale
  • Embedded optimization
  • Latency, memory, and compute constraints
  • Radar physics
  • Digital signal processing fundamentals
  • CUDA development
  • Custom CUDA kernels
  • GPU-accelerated components
  • Publication record or recognized contributions in deep learning, radar perception, multi-sensor fusion, or autonomous systems

What the JD emphasized

  • 12+ years of hands-on experience
  • track record of taking models from prototype to production
  • Proven experience in data-driven development
  • Strong programming skills in Python and/or C++
  • Excellent communication and collaboration skills
  • BS/MS/PhD in Computer Science, Electrical Engineering, Robotics, or related fields (or equivalent experience)

Other signals

  • transformer-based foundation models
  • multi-sensor fusion
  • production deep learning
  • radar perception
  • autonomous driving