Software Engineer, AI Networking Architect

NVIDIA NVIDIA · Semiconductors · Tel Aviv, Israel +1

NVIDIA is seeking an AI Networking Architect to optimize AI workload performance by analyzing AI models, distributed training, and inference workloads, and translating research insights into software, hardware, and networking architecture requirements. The role involves building platforms and simulations to evaluate trade-offs and influence future NVIDIA product roadmaps.

What you'd actually do

  1. Model the performance of complex AI workloads to identify bottlenecks and recommend system-level optimizations.
  2. Analyze brand-new AI models, distributed training techniques, and inference workloads to understand their infrastructure requirements.
  3. Build Platforms, simulations and HW platforms, execute AI workloads and build analytical tools to evaluate trade-offs across compute, memory, storage, and network behavior.
  4. Translate research insights and workload behavior into actionable software, hardware, and networking architecture requirements.
  5. Partner with architecture, software, and product teams to influence future NVIDIA networking and AI infrastructure roadmaps.

Skills

Required

  • B.Sc. Or M.Sc. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience
  • 3+ years of relevant industry or research experience
  • Strong machine learning or data science background
  • Hands-on experience in LLMs, generative AI, or deep learning systems
  • Strong systems-level thinking
  • Ability to estimate end-to-end requirements across the AI stack
  • Ability to translate research findings and product requirements into clear software and hardware specifications
  • Excellent research skills
  • Ability to digest academic papers
  • Ability to self-learn new domains
  • Ability to independently test hypotheses
  • Advanced programming skills for performance modeling, data analysis, and prototyping
  • Excellent communication skills
  • Proficiency in presenting complex technical findings clearly and confidently

Nice to have

  • Experience with distributed training
  • Experience with distributed inference
  • Experience with large-scale AI serving systems
  • Experience in Agentic programming
  • Experience with AI tools
  • Familiarity with GPU clusters
  • Familiarity with collective communication
  • Familiarity with storage systems
  • Familiarity with AI networking bottlenecks

What the JD emphasized

  • B.Sc. Or M.Sc. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
  • 3+ years of relevant industry or research experience.
  • Strong machine learning or data science background, with hands-on experience in LLMs, generative AI, or deep learning systems.
  • Strong systems-level thinking, capable of estimating end-to-end requirements across the AI stack.
  • Shown ability to translate research findings and product requirements into clear software and hardware specifications.
  • Excellent research skills, including the ability to digest academic papers, self-learn new domains, and independently test hypotheses.
  • Advanced programming skills for performance modeling, data analysis, and prototyping.
  • Excellent communication skills, demonstrating proficiency in presenting complex technical findings clearly and confidently.

Other signals

  • AI networking architect
  • AI workload optimization
  • distributed systems
  • data center infrastructure