Sr / Staff Machine Learning Engineer, Perception

Rivian Rivian · Auto · Palo Alto, CA · Autonomous Driving

Sr/Staff ML Engineer for Rivian's Perception Team, focusing on developing, deploying, and optimizing ML models for autonomous vehicle safety-critical features. Responsibilities include owning the ML model lifecycle, architecting data pipelines, developing evaluation tools, and optimizing system performance for real-time embedded deployment.

What you'd actually do

  1. Independently own the design, development, testing, deployment, and maintenance of perception ML models and supporting software for autonomous vehicle applications— including both onboard and cloud environments.
  2. Drive the creation and continuous improvement of production-ready perception models for real-time embedded deployment (object detection, tracking, segmentation, pose estimation, scene understanding, etc.), ensuring robustness, performance, and resilience.
  3. Architect and build scalable data pipelines and training infrastructure to support ML model iteration with large, complex multi-modal datasets, including auto-labeling and data augmentation capabilities.
  4. Develop tools and processes to evaluate and measure the performance and health of perception and/or cabin-monitoring systems, and ensure integration with downstream autonomy modules.
  5. Analyze, debug, and optimize perception system performance, from offline metrics and simulation validation to live, in-vehicle operation, addressing limitations like manual labeling bandwidth, ground truth availability, and real-world heterogeneity.

Skills

Required

  • Python
  • PyTorch
  • TensorFlow
  • C++
  • deep learning models
  • autonomous vehicles
  • robotics
  • safety-critical systems
  • perception models
  • training infrastructure
  • large-scale datasets
  • distributed environments
  • Vision foundation models
  • temporal/spatial modeling
  • attention/transformer architectures
  • auto-labeling systems
  • data augmentation
  • Sensor signal decoding
  • multi-modal sensor fusion
  • pose/trajectory estimation
  • action or intent recognition
  • driver/passenger monitoring
  • System and algorithmic optimization
  • software engineering best practices
  • empirical performance analysis
  • communication
  • collaboration

Nice to have

  • cabin monitoring
  • gaze estimation
  • facial expression analysis
  • action recognition
  • auto-labeling tools
  • cloud-based ML ops
  • open-source contributions

What the JD emphasized

  • safety-critical
  • real-time embedded deployment
  • production-ready perception models
  • large, complex multi-modal datasets
  • real-time embedded systems

Other signals

  • deployment on real vehicles
  • real-time embedded deployment
  • production-ready perception models
  • large, complex multi-modal datasets