Staff Software Engineer, Teleoperation

Agility Robotics Agility Robotics · Robotics · Fremont +2 · Software Engineering

Staff Software Engineer to architect and build production-quality teleoperation systems for humanoid robots, enabling complex manipulation tasks and collecting human demonstration data for scaling robot fleet operations.

What you'd actually do

  1. Own the end-to-end architecture of the teleoperation system, from operator input through real-time robot execution, ensuring low latency, predictable behavior, and clear system boundaries
  2. Integrate and optimize real-time control, streaming, and communication paths to meet measurable latency and bandwidth targets
  3. Design and implement scalable teleoperation interfaces, including VR, motion capture, and other modalities, to enable high-quality manipulation and locomotion demonstrations
  4. Develop comprehensive validation strategies in simulation and on hardware, including performance benchmarks, fault handling, and regression testing
  5. Analyze teleoperation and demonstration data to improve operator efficiency, system responsiveness, and task success rates

Skills

Required

  • Robotics
  • Real-time systems
  • Production-quality software development
  • Real-time control systems
  • Motion retargeting
  • Rigid body dynamics
  • Low-latency communication systems
  • Streaming systems
  • Systems intuition
  • Performance debugging
  • Data-driven validation
  • System reliability
  • VR integration
  • Motion capture integration
  • Wearable device integration

Nice to have

  • Unity
  • Unreal
  • Godot
  • SteamVR
  • OpenXR
  • Neural radiance fields
  • Gaussian splatting
  • Scene reconstruction
  • Large-scale data collection pipelines
  • Learning from demonstration

What the JD emphasized

  • 8+ years of experience in robotics or real-time systems, with a demonstrated track record of delivering reliable, production-quality software
  • Deep understanding of real-time control systems, motion retargeting, and rigid body dynamics
  • Experience designing low-latency communication and streaming systems for real-time applications
  • Strong systems intuition with the ability to trace performance issues across software, networking, and hardware boundaries
  • Strong analytical and debugging skills, with a data-driven approach to performance validation and system reliability
  • Hands-on experience integrating human input systems such as VR, motion capture, wearable devices, or other operator interfaces

Other signals

  • production-quality teleoperation systems
  • human demonstration data collection
  • scale up the world's first production humanoid robot fleet