Xr Audio Face Tracking ML Software Engineer

Google Google · Big Tech · Zürich, Switzerland

Software Engineer for Google's XR team focusing on developing and optimizing ML models for real-time facial motion tracking from multimodal inputs on low-power XR devices. The role involves algorithm research, data synthesis, performance optimization, and delivering production-ready models and pipelines.

What you'd actually do

  1. Research and develop algorithms and models for tracking and synthesizing facial motion from multimodal inputs.
  2. Work with data collection and synthesis teams to gather high-quality training data.
  3. Optimize models and algorithms to run on low-power XR devices in real time.
  4. Propose KPIs and metrics, and incorporate user feedback into the algorithm and model design.
  5. Be able to work alongside other software engineers and research scientists to deliver production-ready models and pipelines.

Skills

Required

  • Python
  • ML models
  • algorithms

Nice to have

  • JAX
  • deep learning frameworks
  • edge frameworks
  • LiteRT
  • polygonal mesh representations
  • skeletal animation pipelines
  • C++

What the JD emphasized

  • low-power XR devices
  • real time

Other signals

  • XR
  • AI
  • multimodal
  • real-time optimization
  • low-power devices