NVIDIA is at the forefront of the AI revolution, specifically in the constantly evolving field of Embodied AI. We are seeking a high-caliber Deep Learning Engineer to bridge the gap between cutting-edge multimodal architectures and real-time robotic execution for autonomous vehicles. In this role, you will design and implement SOTA algorithms to make LLM/VLM fast, lean, and reliable enough to power an end-to-end driving stack. You won’t just be "running" models; you will be re-architecting them for the edge, ensuring that models capable of complex scene reasoning can operate within the strict latency and safety constraints of an AV compute platform.
What You’ll Be Doing:
- Develop SOTA model optimization techniques, such as speculative decoding with block diffusion, KV cache streaming, and Prefill–Decode separation, etc. to boost E2E model performance for production deployments.
- Implement advanced compression techniques including Quantization (FP4/FP8), pruning, and knowledge distillation to minimize model footprints without compromising safety-critical accuracy.
- Design high-performance optimization strategies for inference, including automated model sharding (tensor/sequence parallelism) and the development of efficient attention kernels optimized for KV-caching.
- Conduct deep, layer-by-layer model profiling to identify compute and memory bottlenecks, driving targeted optimizations for real-time execution.
- Leverage the PyTorch ecosystem to extract standardized model graph representations and automate deployment pipelines for TensorRT conversion.
- Scale DL model performance across diverse NVIDIA edge architectures, maximizing the throughput of specialized accelerators on the road.
- Architect the software interface to seamlessly integrate and interact with large-scale models within a high-performance C++ production environment.
- Partner with research, TensorRT, and Cosmos teams to translate breakthrough innovations into shipping product solutions.
What We Need to See:
- PhD with 4+ years, MS with 6+ years, or BS (or equivalent experience) with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
- Expert-level proficiency in PyTorch, JAX, or similar machine learning frameworks.
- Sophisticated proficiency with modern LLM/VLM inference stacks, such as vLLM, TensorRT-LLM and SGLang.
- A proven track record of training, deploying, or optimizing large-scale DL models in production environments.
- Deep familiarity with NVIDIA’s deep learning SDKs, specifically TensorRT and CUDA.
- Strong understanding of GPU architecture, the compilation stack, and the ability to debug end-to-end performance across the hardware/software boundary.
Ways to Stand Out from the crowd:
- Deep experience with LLM, VLM, and VLA model optimization, specifically tailored for real-time robotic control, embodied AI, and autonomous decision-making.
- Proven track record of implementing low-bit inference
- Prior experience writing custom high-performance kernels using CUDA, Triton, or CUTLASS to accelerate non-standard neural network layers and specialized attention mechanisms.
- Active contributions to open-source inference and optimization libraries such as vLLM, SGLang and TensorRT-LLM.
- Thorough understanding of the unique constraints of real-time robotics, including safety-critical determinism, hardware-in-the-loop (HIL) testing, and ultra-low latency requirements.
At NVIDIA, we’re dedicated to making self-driving vehicles a reality and believe this technology can save millions of lives. Join a team of innovative thinkers at one of the world’s most respected technology companies. If you’re motivated, curious, and ready to make a difference, we’d love to meet you! We believe that building self-driving vehicles will be a defining contribution of our generation (e.g. traffic accidents are responsible for ~1.25 million deaths per year world-wide). We have the funding and scale, but we need your help on our team. NVIDIA is widely considered to be one of the technology world’s most desirable employers with some of the most forward-thinking people in the world working here. If you're entrepreneurial and autonomous, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until April 25, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.