Principal Deep Learning Engineer – Perception, Autonomous Driving

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA

Principal Deep Learning Engineer for NVIDIA's Autonomous Driving Perception team, focusing on developing, training, and deploying state-of-the-art perception systems (detection, segmentation, tracking) for vehicles. The role involves leading the end-to-end productization of these models, ensuring high quality and safety, defining data strategy, and providing technical leadership. Requires extensive experience in deep learning for computer vision and shipping commercial DL products.

What you'd actually do

  1. Develop, train, and deploy modern, state-of-the-art deep learning architectures (e.g., Transformers, variants of Transformers, Few Shots Learning) for 3D obstacle detection, dense occupancy prediction, semantic segmentation, and multi-object tracking.
  2. Drive the end-to-end productization of perception models. You will have ownership of shipping robust, production-grade deep learning features to our global automotive customers, ensuring they meet the highest standards of safety and quality.
  3. Champion a rigorous, safety-critical development process. You will proactively identify, mine, and solve long-tail corner cases in sophisticated urban and highway driving environments.
  4. Define data labeling guidelines, establish quality control metrics, and work closely with data operations to ensure high-fidelity ground truth for sophisticated perception tasks.
  5. Serve as a technical pillar for the perception organization. You will mentor senior engineers, influence cross-functional teams (planning, mapping, and infrastructure), and set the technical roadmap for next-generation perception architectures.

Skills

Required

  • Ph.D. or MS in Computer Science, Robotics, Machine Learning, Computer Vision, or a related field (or equivalent experience)
  • 12+ years of applied research and software engineering experience, with a heavy emphasis on deep learning for computer vision
  • Proven Track Record: Demonstrated success as a lead technical contributor in shipping commercial, high-quality deep learning software products to end customers.
  • Domain Expertise: Deep foundational knowledge and hands-on experience in building architectures for object detection, occupancy networks, semantic/instance segmentation, and temporal tracking.
  • Data Intuition: A strong intuition for data-centric AI. Proven experience taking care of massive datasets, defining labeling taxonomies, and building automated pipelines to surface hard examples and edge cases.
  • Engineering Excellence: Strong programming skills in Python and C++, with experience using deep learning frameworks like PyTorch.

Nice to have

  • Prior experience specifically within the autonomous driving or robotics industry shipping models deployed on edge compute.
  • Experience with model optimization, quantization, and deployment on embedded platforms (especially using NVIDIA TensorRT).
  • First-author publications at top-tier computer vision or machine learning conferences (e.g., CVPR, ICCV, ECCV, NeurIPS).
  • Experience designing multi-modal perception systems (camera, lidar, radar fusion).

What the JD emphasized

  • shipping commercial, high-quality deep learning software products to end customers
  • shipping models deployed on edge compute
  • model optimization, quantization, and deployment on embedded platforms

Other signals

  • shipping production deep learning features
  • end-to-end productization of perception models
  • technical leadership for perception organization