Runtime/driver Software Development Engineer, Neuron Runtime

Amazon Amazon · Big Tech · Austin, TX · Software Development

Software Development Engineer focused on the runtime and driver software stack for AWS Inferentia and Trainium machine learning accelerators. This role involves deep work in Linux, device drivers, and hardware-software interaction to ensure high performance and throughput for inference and training. The engineer will contribute to defining interfaces, developing the runtime, and working in pre-silicon environments for readiness and validation.

What you'd actually do

  1. Define the key interfaces and will develop the runtime stack and driver that manages the accelerator.
  2. Work in pre-silicon environments (such as emulation) to shift-left Runtime Software Stack readiness and to develop validation content to checkout HW/Silicon features.
  3. Implement high performance software drivers, needed to ensure high throughput from software to hardware.
  4. Deep knowledge and experience with hardware-based accelerator platforms and the necessary complexity for the software layers that interact and manage them.

Skills

Required

  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience programming with at least one software programming language
  • Linux
  • device drivers
  • hardware-based accelerator platforms
  • high performance software drivers
  • runtime stack
  • pre-silicon environments
  • validation content

Nice to have

  • 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Bachelor's degree in computer science or equivalent
  • Experience in computer architecture
  • Experience writing low level drivers

What the JD emphasized

  • deep background in Linux and device drivers
  • Deep knowledge and experience with hardware-based accelerator platforms
  • Experience implementing high performance software drivers
  • high throughput from software to hardware
  • runtime stack and driver that manages the accelerator
  • pre-silicon environments
  • shift-left Runtime Software Stack readiness
  • validation content to checkout HW/Silicon features