Staff AI Engineer, Perception

Agility Robotics Agility Robotics · Robotics · Fremont, CA · Software Engineering

Staff AI Engineer, Perception at Agility Robotics, focusing on designing, developing, and deploying object detection and tracking algorithms for humanoid robots. The role involves technical leadership, optimizing ML models for embedded systems, and collaborating with other engineering teams to integrate perception capabilities into production robots.

What you'd actually do

  1. As a technical lead, you will own the architecture and technical roadmap for object perception systems used by the robot in production
  2. Design, develop, and deploy machine learning algorithms for multi-object detection, scene understanding, and 6-DoF object pose estimation
  3. Evaluate and drive adoption of state-of-the-art perception models
  4. Promote best practices in architecture, design, and testing to deliver high-quality, scalable software
  5. Optimize deep neural networks and associated data processing to run efficiently on embedded systems

Skills

Required

  • 5+ years of experience deploying machine learning-based object detection algorithms on mobile robots
  • 2 years of experience in a technical leadership role
  • Proficiency in deep convolutional neural networks
  • Proficiency in multi-object tracking
  • Proficiency in data association
  • Proficiency in supervised learning
  • Proficiency in pose estimation
  • Strong mathematical fundamentals in linear algebra
  • Strong mathematical fundamentals in numerical optimization
  • Familiarity with core geometric concepts in computer vision
  • Familiarity with PyTorch
  • Familiarity with OpenCV
  • Familiarity with NumPy
  • Experience designing and optimizing algorithms for efficient execution across CPU and GPU architectures
  • Experience with MLOps (data annotation services, data storage, model evaluation tools, model deployment)

Nice to have

  • Experience using YOLO
  • Experience using Faster/Mask R-CNN
  • Experience developing ML models for 3 or 6 dof pose estimation

What the JD emphasized

  • deploying machine learning-based object detection algorithms on mobile robots
  • technical leadership role
  • Publications in your field (CVPR, ICCV, RSS, ICRA preferred)

Other signals

  • Deploying machine learning algorithms for object detection and tracking on mobile robots
  • Own the architecture and technical roadmap for object perception systems
  • Optimize deep neural networks for embedded systems