Principal Hardware Engineer, AI Systems

Microsoft Microsoft · Big Tech · Redmond, WA +4 · Hardware Engineering

Principal Hardware Engineer focused on AI Systems, responsible for leading the end-to-end technical ownership of next-generation AI and GPU platforms from architecture to production deployment. This role involves driving cross-functional technical execution across hardware, firmware, software, and datacenter infrastructure, making critical system-level tradeoffs, and evaluating new technologies like AI accelerators and liquid cooling. The engineer will collaborate with partners and suppliers to ensure successful integration and production readiness, communicating technical status to leadership.

What you'd actually do

  1. Serve as the System Technical Lead (STL) and end-to-end technical owner for next-generation AI and GPU platforms from architecture handoff through production deployment and fleet readiness.
  2. Partner closely with System Architects to translate product requirements, workload needs, architectural intent, and new technologies into executable system designs, engineering requirements, and development plans.
  3. Drive program-level technical execution across hardware, firmware, software, validation, manufacturing, and datacenter infrastructure teams, ensuring alignment to system requirements, architecture specifications, schedule, and quality objectives.
  4. Lead cross-functional technical decision making and resolve complex system-level tradeoffs spanning performance, power, thermal, mechanical, reliability, manufacturability, serviceability, cost, and total cost of ownership (TCO).
  5. Own technical readiness for key program milestones, design reviews, phase exits, and production releases, ensuring engineering deliverables are complete, integrated, and meet quality expectations.

Skills

Required

  • Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience.

Nice to have

  • Proven track record leading cross-functional technical execution across hardware, firmware, software, and datacenter infrastructure.
  • Deep system expertise in power delivery, thermal and liquid cooling, signal integrity, mechanical design, and reliability.
  • Experience bringing high-volume silicon platforms (GPU, SoC, accelerator) from architecture through production ramp.
  • Hands-on experience with PCIe, DDR, Ethernet, BIOS/BMC, and Linux and Windows integration.
  • Experience with datacenter-scale AI systems, including system debug and root cause analysis.
  • Proven ability to evaluate AI systems using performance-per-watt and performance-per-dollar metrics.
  • Clear, concise communicator with the ability to influence technical direction across teams and at senior levels.
  • BS / MS in Electrical/Computer Engineering or equivalent industry experience
  • 10+ years of relevant experience in system (compute, storage, networking, and/or accelerator) level design and/or implementation across the hardware development lifecycle.
  • 10+ years of hands-on experience in server hardware architecture, design, and development with solid understanding of hardware, firmware, and Operating

What the JD emphasized

  • end-to-end technical owner
  • system-level tradeoffs
  • technical readiness
  • datacenter-scale AI systems

Other signals

  • AI accelerators
  • GPU platforms
  • datacenter-scale AI systems