Senior Software Engineer, Spatial Intelligence and Foundation Models

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA

Senior Software Engineer role focused on spatial intelligence and foundation models for robotics, involving algorithm design, perception systems development, training vision-language models, and integrating research into products. Requires strong computer vision, deep learning, and agentic tool use skills.

What you'd actually do

  1. Design, implement, and deploy novel algorithms for spatial understanding, working on problems ranging from SLAM, structure-from-motion, optical flow, scene flow, and object reconstruction to training VLMs on a wide range of spatial reasoning skills.
  2. Develop robust perception, mapping, and reasoning systems that run on robots, in simulation, and at scale in data pipelines for training foundation models.
  3. Advance the state of the art in geometric computer vision, combining classical multi-view geometry and optimization with modern deep learning approaches.
  4. Train and evaluate vision-language models on skills relevant to robotics.
  5. Work closely with the Cosmos and GR00T teams on perception and spatial understanding for foundation models and collaborate with other Isaac teams including Sim/Lab, Platform and SQA to deploy, validate, extend and release capabilities & features on physical robots as well as in at-scale simulations.

Skills

Required

  • Computer Vision
  • Robotics
  • Deep Learning
  • 3D Geometric Computer Vision
  • SLAM
  • Structure-from-motion
  • Visual Odometry
  • Python
  • C++
  • PyTorch
  • JAX
  • TensorFlow
  • Agentic Tool Use
  • AI Coding Agents
  • Agentic Workflows

Nice to have

  • Vision-Language Models
  • Large-scale model training
  • GPU clusters
  • Foundation Models
  • Simulation-based training
  • Sim-to-real transfer
  • Real-to-sim transfer
  • Publications at top computer vision or robotics venues
  • Contributions to widely used SLAM, SfM, or 3D reconstruction systems

What the JD emphasized

  • 8+ years of experience working on computer vision, robotics, or deep learning technologies
  • Strong foundation in 3D geometric computer vision
  • Strong hands-on programming skills in Python and/or C++
  • Experience training and evaluating deep learning models for perception tasks
  • Strong skills in agentic tool use

Other signals

  • training foundation models
  • robotics perception systems
  • spatial understanding
  • geometric computer vision
  • vision-language models