Research Scientist Intern, Multimodal Contextual AI (phd)

Meta Meta · Big Tech · Redmond, WA

Research Scientist Intern focused on on-device contextual AI for AR devices, involving computer vision, audio interaction, and LLMs. The role requires building and characterizing experimental HW+SW systems on AR devices, developing embedded firmware, and collaborating across disciplines. Candidates should be pursuing a PhD and have experience with C/C++, Python, ML frameworks, and embedded systems.

What you'd actually do

  1. Build and characterize experimental HW+SW systems on AR devices and device prototypes
  2. Develop embedded firmware and software in RTOS and mobile operating systems, e.g. AOSP
  3. Collaborate with other researchers and engineers across various disciplines

Skills

Required

  • PhD in Computer Science, Electrical Engineering, or related field (or in progress)
  • Programming experience with C/C++ and Python
  • Experience with computer architecture and HW/SW co-design and co-optimization
  • Experience in HW+SW system prototyping using embedded device prototypes and FPGAs
  • Experience in operating systems, drivers, and embedded firmware development
  • Experience working in a machine learning framework, e.g. PyTorch
  • Demonstrated embedded software experience

Nice to have

  • Experience with AR devices
  • Experience with contextual AI
  • Experience with computer vision
  • Experience with audio interaction
  • Experience with large language models

What the JD emphasized

  • performance, power and form-factor constraints
  • real-time embedded software development
  • hardware acceleration
  • first-authored publications at leading workshops or conferences such as CVPR, ECCV/ICCV, SIGGRAPH, or similar

Other signals

  • on-device contextual AI
  • real-time embedded software development
  • hardware acceleration
  • performance, power and form-factor constraints