Principal Software Engineer - Dgx Cloud

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA +1

Principal Software Engineer for NVIDIA's DGX Cloud team, focusing on building and scaling foundational systems for high-performance GPU infrastructure. The role involves leading the development of next-generation APIs, state management, and workflow orchestration systems to automate fleet lifecycle operations at scale, integrating AI schedulers and observability tools.

What you'd actually do

  1. Lead the build and development of next-generation APIs, state management, and workflow orchestration systems that automate fleet lifecycle operations at a massive scale.
  2. Drive technical alignment across dependent systems and partner teams to ensure cohesive integration, clear interfaces, and reliable end-to-end workflows, with a strong focus on delivery.
  3. Act as a force-multiplier by coaching, mentoring, and encouraging senior engineers, elevating the technical standards and guidelines across the organization.
  4. Maintain an incredible focus on the customer experience and product requirements, translating deep technical insight into high-impact business solutions.
  5. Partner with executive and engineering leadership to codify critical business processes into self-measuring, scalable, and operationally consistent platforms, drastically reducing manual toil.

Skills

Required

  • 16+ years of progressive industry experience
  • Master's or Bachelor's degree, or equivalent experience defining and shipping complex distributed systems.
  • Deep, hands-on expertise in establishing, operating, and scaling services in a fast paced, high-reliability environment.
  • Thrive in ambiguous, fast paced environments by rapidly testing ideas, iterating toward working solutions, and then hardening the winners into reliable, scalable systems.
  • Outstanding proficiency in modern systems programming languages such as Go, Java, or Python.
  • Proven track record of defining, owning, and evolving the architecture of high-scale distributed systems, including advanced patterns for APIs, control planes, and data pipelines.
  • Deep understanding of global cloud infrastructure (AWS, GCP, Azure) and container ecosystems (Docker, Kubernetes).
  • Demonstrated ability to drive technical strategy and influence outcomes across organizational boundaries.
  • Outstanding ability to communicate complex technical concepts, drive organizational consensus, and mentor high-performing engineers.

Nice to have

  • A history of successfully leading the development and adoption of organization-wide workflow orchestration systems for petabyte-scale infrastructure.
  • Experience in a Principal/Staff+ capacity, delivering measurable improvements in operational efficiency, reliability, and security across a large engineering org.
  • Deep familiarity with the operational and deployment aspects of the NVIDIA AI/ML software stack (CUDA, cuDNN, containerization).
  • Patent contributions or a strong publication record in areas related to distributed systems, cloud computing, or infrastructure automation.

What the JD emphasized

  • massive scale
  • massive scale
  • high-reliability environment
  • high-scale distributed systems
  • petabyte-scale infrastructure
  • large engineering org

Other signals

  • building foundational systems for AI infrastructure
  • crafting scalable automation solutions
  • enabling seamless workflows across global cloud operations
  • leading the build and development of next-generation APIs, state management, and workflow orchestration systems
  • automating fleet lifecycle operations at a massive scale
  • integrating key technologies, including common AI schedulers (e.g., Kubernetes, Slurm) and innovative observability systems