AI Algorithm Expert - Hand Tracking, Pico - San Jose

ByteDance ByteDance · Big Tech · San Jose, CA · R&D

Develop and optimize high-precision, low-latency hand tracking algorithms for XR scenarios, including monocular/multiple vision and multi-sensor fusion. Build 3D gesture pose estimation models for challenging conditions, optimize real-time inference performance on mobile XR headsets, and lead the development of a multimodal ML interaction framework for natural XR interaction. Promote patent layout and publish papers in top conferences.

What you'd actually do

  1. Lead the development of high-precision and low-latency hand tracking algorithms in XR scenarios, covering directions such as monocular/multiple vision and multi-sensor fusion
  2. Build a robust 3D gesture pose estimation model to solve the problems of extreme scenarios such as occlusion, fast motion and complex illumination
  3. Optimize the real-time inference performance of the algorithm on the mobile XR headset to achieve millimeter-level tracking accuracy
  4. Lead the construction of the MultiModal Machine Learning interaction algorithm framework (hand + eye movement + peripheral device) to create a natural XR interaction pattern
  5. Promote patent layout and publication of papers in accredited conferences (CVPR/ICCV/SIGGRAPH, etc.) to enhance the technical influence of the team

Skills

Required

  • Computer Vision
  • Pattern Recognition
  • Applied Mathematics
  • algorithm R&D
  • PyTorch
  • QNN deployment ecosystem
  • TensorRT end-side optimization

Nice to have

  • SLAM
  • 3D reconstruction
  • multi-sensor fusion
  • ARKit Hand Tracking
  • Quest Hand Tracking
  • HandTracking for XR products

What the JD emphasized

  • high-precision and low-latency hand tracking algorithms
  • real-time inference performance
  • hand tracking
  • gesture tracking

Other signals

  • hand tracking algorithms
  • 3D gesture pose estimation
  • real-time inference performance
  • MultiModal Machine Learning interaction algorithm framework