Applied Scientist II - Robotics Simulation, Amazon Robotics R&d

Amazon Amazon · Big Tech · Boston, MA · Applied Science

The Applied Scientist II role focuses on designing, building, and validating simulation environments and policy training pipelines for robots to learn manipulation and mobility skills in simulation and transfer them to real hardware. This involves working with GPU-accelerated RL environments, imitation learning, characterizing sim-to-real gaps, and evaluating learned policies. The role is hands-on and execution-focused, owning simulation science deliverables end-to-end.

What you'd actually do

  1. Design and implement GPU-accelerated reinforcement learning and imitation learning environments in NVIDIA Isaac Lab for manipulation and mobility tasks.
  2. Build and maintain policy training pipelines supporting diverse model architectures (diffusion policies, VLAs, behavior cloning, actor-critic RL) and evaluate trained policies in simulation.
  3. Characterize and reduce sim-to-real gaps through systematic validation: compare simulated sensor outputs, kinematics, and dynamics against real-world robot data, then implement targeted improvements.
  4. Implement domain randomization strategies (visual, physics, geometric) to improve policy robustness and transfer to real hardware.
  5. Develop sim-to-real transfer techniques including system identification, physics parameter calibration, and visual domain adaptation.

Skills

Required

  • PhD or Master's degree
  • Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
  • Experience in robotics design, automation systems development, control systems design, or related product development
  • 2+ years of experience working with physics simulation platforms for robot learning (MuJoCo, Isaac Sim/Lab, PyBullet, Drake, or equivalent)
  • Demonstrated experience training robot policies using reinforcement learning or imitation learning and evaluating them in simulation
  • Experience with articulated robot simulation, including URDF/MJCF/USD formats and rigid/soft body dynamics
  • Familiarity with sim-to-real transfer concepts (domain randomization, system identification, or physics calibration)

Nice to have

  • Hands-on experience deploying learned policies on real robot hardware (manipulation arms, mobile platforms, or mobile manipulators)
  • Experience with NVIDIA Isaac Lab/Sim, Omniverse, or USD-based simulation workflows
  • Experience with modern Physical AI architectures: vision-language-action models, diffusion-based policy learning, action-chunking transformers, or behavior cloning from demonstrations
  • Familiarity with teleoperation systems and demonstration data collection pipelines (haptic devices, recording in HDF5/zarr)

What the JD emphasized

  • robotics simulation science
  • Physical AI
  • GPU-accelerated RL environments
  • imitation learning workflows
  • sim-to-real gaps
  • real-world robot data
  • learned policies
  • robot learning
  • simulation infrastructure
  • Physical AI development
  • photorealistic synthetic data
  • GPU-accelerated training environments
  • digital twins
  • teleoperation data collection infrastructure
  • scalable synthetic demonstration generation
  • policy training and inference pipelines
  • domain randomization for sim-to-real transfer
  • model validation in simulation
  • robotics programs
  • ML frameworks
  • JAX
  • PyTorch
  • vLLM
  • SGLang
  • Dynamo
  • TorchXLA
  • TensorRT
  • robotics design
  • automation systems development
  • control systems design
  • product development
  • physics simulation platforms
  • robot learning
  • MuJoCo
  • Isaac Sim/Lab
  • PyBullet
  • Drake
  • robot policies
  • reinforcement learning
  • imitation learning
  • articulated robot simulation
  • URDF/MJCF/USD formats
  • rigid/soft body dynamics
  • sim-to-real transfer concepts
  • domain randomization
  • system identification
  • physics calibration
  • learned policies
  • real robot hardware
  • manipulation arms
  • mobile platforms
  • mobile manipulators
  • NVIDIA Isaac Lab/Sim
  • Omniverse
  • USD-based simulation workflows
  • Physical AI architectures
  • vision-language-action models
  • diffusion-based policy learning
  • action-chunking transformers
  • behavior cloning from demonstrations
  • teleoperation systems
  • demonstration data collection pipelines
  • haptic devices
  • recording in HDF5/zarr

Other signals

  • robot learning
  • simulation environments
  • policy training pipelines
  • sim-to-real transfer
  • reinforcement learning
  • imitation learning