Member of Technical Staff, Microsoft Robotics (human-robot-ai Interaction)

Microsoft Microsoft · Big Tech · Redmond, WA +1 · Product Design

This role focuses on designing the human-robot-AI interaction and interfaces for Microsoft's robotics platform, enabling collaboration between people, robots, and AI agents. It involves creating interaction paradigms for natural language commands, AR overlays, gesture input, and trust calibration mechanisms, aiming to establish Microsoft's design language for physical AI experiences.

What you'd actually do

  1. Design end-to-end human-robot interaction (HRI) and human-AI teaming experiences, including natural language task instruction interfaces, shared autonomy control panels, intent and status communication displays, and trust calibration mechanisms.
  2. Create wireframes, journey maps, user jobs and scenarios, task flows, and personas for diverse users who interact with robots, ranging from factory floor operators and warehouse associates to lab researchers and first responders.
  3. Develop interaction models for multimodal communication between humans and robots, including voice, gesture, gaze, spatial input (AR/MR), touchscreen and future multi-sensory paradigms, ensuring seamless transitions between modalities.
  4. Produce visual designs from concept to delivery for robot status communication (e.g., intent signaling, confidence indicators, uncertainty visualization), user-facing explainability surfaces, and collaborative task-handoff interfaces.
  5. Build and validate interactive prototypes, including mixed-modality and immersive experiences, that demonstrate human-robot-agent collaboration concepts to stakeholders and customers.

Skills

Required

  • Industrial Design, Product Design, Human Computer Interaction, User Experience, Interaction Design, or related field
  • experience working in product or service design

Nice to have

  • natural language command interfaces
  • augmented reality overlays
  • gesture and spatial input
  • shared autonomy handoff patterns
  • trust calibration mechanisms
  • voice
  • gesture
  • gaze
  • spatial input (AR/MR)
  • touchscreen
  • multi-sensory paradigms
  • robotics software
  • AI safety experts
  • Fluent design language

What the JD emphasized

  • human-robot-AI interaction
  • agentic AI workflows
  • human-robot-AI interaction

Other signals

  • design of human-robot-AI interaction and interfaces
  • people, robots, and AI agents to collaborate
  • physically grounded agentic AI workflows
  • human-robot-AI interaction and interfaces