Director, Software Architecture

NVIDIA NVIDIA · Semiconductors · Tel Aviv, Israel +3

NVIDIA is looking for a Director of Software Architecture to lead the evolution of next-generation AI data center and networking technologies. The role involves driving the adoption of emerging technologies, designing advanced networking applications, and architecting solutions across AI data center environments, integrating GPU-based systems and hardware acceleration. The ideal candidate will have extensive experience in software architecture, systems design, applied research, and leading engineering teams, with strong expertise in AI inference technologies and networking protocols.

What you'd actually do

  1. Drive identification, evaluation, and rapid adoption of emerging technologies, ensuring strong alignment with strategic roadmap and measurable business outcomes.
  2. Lead the design and delivery of advanced networking applications, leveraging data plane programming and modern networking protocols to solve complex, large-scale challenges.
  3. Architect solutions across AI data center environments, integrating GPU-based systems, hardware acceleration, and high-performance networking.
  4. Act as a thought leader and industry influencer—engaging directly with customers, publishing technical content, and representing NVIDIA at key conferences and forums.
  5. Define and execute a bold architectural vision for NVIDIA networking in close collaboration with cross-functional software and hardware leaders.

Skills

Required

  • software architecture
  • systems design
  • applied research
  • leadership
  • AI inference technologies
  • large-scale distributed systems
  • networking protocols
  • data center networking architectures
  • AI DC architectures
  • hardware acceleration technologies
  • SDKs
  • AI data center design
  • communication skills
  • influence skills

Nice to have

  • prototyping
  • validation
  • scaling new ideas into production
  • system software
  • operating systems
  • low-level architecture
  • hyperscale cloud
  • AI data center environments
  • AI storage systems
  • high-performance computing (HPC)
  • end-to-end accelerated infrastructure

What the JD emphasized

  • M.Sc. or PhD. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.
  • 12+ years of deep experience in software architecture, systems design, and applied research.
  • 8+ years of proven leadership, building and driving high-performing engineering teams in fast-paced environments.
  • Strong expertise in AI inference technologies, frameworks, and large-scale distributed systems.
  • Hands-on experience with networking protocols (e.g., TCP/IP, RDMA, RoCE, InfiniBand) and data center networking architectures.
  • Deep familiarity with AI DC architectures, hardware acceleration technologies, and SDKs (e.g., DOCA, CUDA or similar).
  • Experience with AI data center design, including compute, networking, and AI storage systems.
  • Exceptional communication and influence skills, with a demonstrated ability to align stakeholders and drive decisions across complex organizations.
  • A track record of aggressively prototyping, validating, and scaling new ideas into production.

Other signals

  • AI data center technologies
  • networking
  • GPU-based systems
  • hardware acceleration