AI Research Scientist - Surface Inputs Ar/vr

Meta · Big Tech · Redmond, WA

Meta's Reality Labs is seeking an AI Research Scientist to develop and productize computer vision and machine learning models for surface inputs and natural interactions in AR/VR products. This role involves leading the full ML production cycle, from development to deployment, and contributing to publications at top-tier venues. The ideal candidate will have extensive experience in shipping ML models to production, particularly for edge devices, and a strong background in computer vision and deep learning frameworks.

What you'd actually do

Lead the productization of CVML models for Surface inputs, including Surface keyboard and Surface trackpad, from development through deployment
Design and execute large-scale experiments with vision models and datasets, defining evaluation protocols and driving research direction
Partner with cross-functional teams to ship ML models end-to-end, from prototype to production
Develop prototypes for future VR/AR/MR experiences and integrate robust solutions into products
Contribute to publications at top-tier venues such as CVPR, ICCV, ECCV, and NeurIPS

Skills

Required

Computer Science, Computer Engineering, or relevant technical field
7+ years of industry experience in machine learning, computer vision, or related fields
Experience shipping ML models to production
Prototyping and engineering experience in at least one specialization: SLAM, State Estimation, Sensor Fusion, 3D reconstruction, object detection, segmentation and tracking, or scene understanding
Writing production-quality code in Python
Deep learning frameworks such as PyTorch
Experience productizing and deploying ML models on edge devices
Publication track record at conferences such as CVPR, NIPS, ECCV, ICCV, ISMAR, ICML, or SIGGRAPH
Experience with real-time SLAM, 3D reconstruction, sensor fusion, object/body tracking, or depth estimation

Nice to have

PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics, or related field
Experience developing CV/ML systems for edge devices (mobile phones, AR/VR headsets, custom hardware)

What the JD emphasized

7+ years of industry experience in machine learning, computer vision, or related fields
Experience shipping ML models to production, including the full ML production cycle from development to deployment
Experience productizing and deploying ML models on edge devices
Publication track record at conferences such as CVPR, NIPS, ECCV, ICCV, ISMAR, ICML, or SIGGRAPH

Other signals

shipping ML models to production
productization of CVML models
real-time image processing
impact billions of people

Read full job description

Meta's Reality Labs (RL) is driving innovation in Augmented and Virtual Reality products. Our XR Tech organization develops machine perception technologies across Quest, Meta Glasses, and Family of Apps—spanning Avatars, AR/VR calling, AR Commerce, and more. In this role, you will research and apply computer vision and machine learning techniques for surface inputs and natural interactions, tackling challenges in hand tracking, micro-gestures, eye tracking, 3D reconstruction, and real-time image processing. You'll collaborate with researchers in Reality Labs Research (RLR) to translate discoveries into production-ready solutions that impact billions of people.

Responsibilities

Lead the productization of CVML models for Surface inputs, including Surface keyboard and Surface trackpad, from development through deployment Design and execute large-scale experiments with vision models and datasets, defining evaluation protocols and driving research direction Partner with cross-functional teams to ship ML models end-to-end, from prototype to production Develop prototypes for future VR/AR/MR experiences and integrate robust solutions into products Contribute to publications at top-tier venues such as CVPR, ICCV, ECCV, and NeurIPS Define and scope projects for other engineers, providing technical direction and success criteria

Qualifications

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience 7+ years of industry experience in machine learning, computer vision, or related fields Experience shipping ML models to production, including the full ML production cycle from development to deployment Prototyping and engineering experience in at least one specialization: SLAM, State Estimation, Sensor Fusion, 3D reconstruction, object detection, segmentation and tracking, or scene understanding Experience writing production-quality code in Python and deep learning frameworks such as PyTorch Experience productizing and deploying ML models on edge devices Publication track record at conferences such as CVPR, NIPS, ECCV, ICCV, ISMAR, ICML, or SIGGRAPH Experience with real-time SLAM, 3D reconstruction, sensor fusion, object/body tracking, or depth estimation PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics, or related field Experience developing CV/ML systems for edge devices (mobile phones, AR/VR headsets, custom hardware)