Staff Software Engineer, Viz & Sim Applications, Autonomy

Rivian Rivian · Auto · Palo Alto, CA · Autonomous Driving

Staff Software Engineer focused on high-performance browser-based rendering for autonomous vehicle sensor data visualization. The role involves architecting and optimizing a 3D rendering engine (Three.js/WebGL) to achieve smooth real-time rendering of large datasets like point clouds and camera feeds, enabling precise analysis of autonomous behaviors.

What you'd actually do

  1. Lead the architectural evolution of our web-based 3D visualization platform (Three.js/WebGL).
  2. Design and implement efficient pipelines using WebWorkers, WebAssembly, and related technologies to decode and render high volume streaming datasets (LiDAR point clouds, radar, cameras, semantic scene understanding) in real-time without blocking the main thread
  3. Write and optimize custom GLSL/WGSL shaders to support new renderable types and visual effects
  4. Implement complex visualization features, such as Birds-Eye-View (BEV) fused camera projections, volumetric rendering, and temporal data alignment
  5. Serve as a source of knowledge for 3D graphics within the team.

Skills

Required

  • TypeScript
  • React
  • WebGL/WebGPU
  • WebWorkers
  • OffscreenCanvas
  • Three.js
  • GLSL/WGSL shaders
  • 3D mathematics
  • GPU architecture
  • performance optimization
  • WebAssembly (WASM)
  • C++ or Rust

Nice to have

  • Robotics data structures (Point Clouds, Transformations/TF)
  • MCAP or ROS bags
  • H.264/H.265 video encoding/decoding
  • WebCodecs API

What the JD emphasized

  • high-performance browser-based rendering
  • architect behind our next-generation visualization platform
  • pushing the boundaries of what is possible in a web browser
  • ownership of our 3D rendering engine
  • stream and render million-point dynamic point clouds and fused camera feeds at a smooth 60 FPS
  • eliminate bottlenecks and ensure consistent 60 FPS performance
  • render high volume streaming datasets
  • real-time without blocking the main thread
  • optimize custom GLSL/WGSL shaders
  • complex visualization features
  • define requirements for immersive, reactive data tools
  • Expert-level proficiency in TypeScript and React.
  • Mastery of browser APIs including WebGL/WebGPU, WebWorkers, and OffscreenCanvas
  • Extensive experience with web-based 3D engines
  • understand its internals and can patch it when necessary
  • track record of optimizing high-throughput data applications