Senior Hardware Architect Artificial Intelligence

NVIDIA NVIDIA · Semiconductors · Yokneam, Israel +1

NVIDIA is seeking a Senior Hardware Architect for their AI-for-Architecture team. This role will define and promote intelligent architecture flows using AI agents, tools, and processes to explore design tradeoffs and validate models. The architect will collaborate with an AI engineering team to develop these flows from concept to production and serve as the technical authority on AI architecture work.

What you'd actually do

  1. Define the roadmap for AI-driven architecture flows — from data collection, modelling and micro-architecture agents that help architects explore feature options, to review and validation agents that set the standard for output quality.
  2. Work with architects on tough problems, suggest and build agentic flows to address these problems and shorten the time to a good solution.
  3. Partner with the AI engineering pod to translate architecture workflows into production agents, MCP integrations, and eval harnesses.
  4. Act as the domain authority and quality judge: recognize what excellent architecture output looks like and verify that AI-assisted flows meet that bar.
  5. Drive adoption: work with networking architects, run beta cycles, close feedback loops and facilitate widespread usage of our tools/methods.

Skills

Required

  • B.A, M.Sc. or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.
  • 6+ years in hardware, firmware, or system architecture — NIC, switch, DPU, CPU, or SoC. Experience with architectural workflows defining microarchitecture specs, performance models, or architecture decision documents, etc..
  • Ability to understand and adopt agentic AI workflows and tools (Claude/Codex/Cursor).
  • Engineering committed to quality — for example, the ability to judge AI output quality for architecture tasks and suggest validation-fix strategies to improve it.
  • Strong interpersonal skills — explain AI flows for architects lacking AI engineering expertise, and distill hardware architecture trade-offs for engineers without architectural backgrounds.
  • Consistent track record driving adoption of new tools or processes across a technical organization.

Nice to have

  • Hands-on experience applying LLMs, agents, or prompt-plus-code pipelines to real engineering work.
  • Expertise with high-speed networking silicon — InfiniBand, Ethernet, switch fabric architecture, NIC/RDMA subsystems.
  • Familiarity with LLMs: transformer architecture (attention, MLP, MoE) and LLM training/inference parallelism (DP, PP, EP, TP).
  • Background defining and measuring engineering productivity metrics — making the impact or our work visible to leadership.
  • Track record shipping internal platform tools or developer-experience infrastructure at scale.

What the JD emphasized

  • define and promote intelligent architecture flows
  • develop the agents, tools, and processes
  • collaborate with an AI engineering team to develop flows from concept to production
  • technical authority on what good AI architecture work means
  • define the roadmap for AI-driven architecture flows
  • build agentic flows
  • translate architecture workflows into production agents
  • Act as the domain authority and quality judge
  • Drive adoption
  • Consistent track record driving adoption of new tools or processes across a technical organization
  • Track record shipping internal platform tools or developer-experience infrastructure at scale

Other signals

  • AI for Architecture team
  • develop agents, tools, and processes
  • collaborate with an AI engineering team
  • technical authority on what good AI architecture work means