Senior Dgx Cloud AI Infrastructure Software Engineer

NVIDIA · Semiconductors · Shanghai, China

Senior Software Engineer role focused on building and integrating AI infrastructure for DGX Cloud, enabling developers to access GPU-optimized virtual machines. Responsibilities include crafting IaaS API integrations, developing a two-sided marketplace, and improving testing and observability for scalable, fault-tolerant solutions.

What you'd actually do

  1. Work with the DGX Cloud Lepton Marketplace team to establish integrations with NVIDIA Cloud Partners, enabling global developers to easily access GPU-optimized virtual machines.
  2. You will craft and implement IaaS API integrations, collaborating with external engineering teams to ensure reliable, scalable, and consistent connectivity across diverse cloud environments.
  3. Shape integration strategies, develop stateful workflow orchestration, and drive improvements in testing, observability, and automation to ensure high-quality, fault-tolerant solutions.
  4. Be responsible for developing the two-sided marketplace, including the integration of compute providers and crafting discovery and bidding experiences to match supply with demand.

Skills

Required

  • software infrastructure for large-scale AI systems
  • Kubernetes
  • cluster operations
  • operator development
  • node health monitoring
  • GPU resource scheduling
  • cloud infrastructure environments (VMaaS, VPCs, RDMA, shared file-systems)
  • 3rd party API integrations
  • communication with external teams
  • writing API clients
  • improving integration reliability
  • systems programming language (Go preferred)
  • software design patterns for stateful workflow orchestration

Nice to have

  • cloud infrastructure
  • distributed systems
  • API development

What the JD emphasized

  • developing software infrastructure for large-scale AI systems
  • Kubernetes
  • GPU resource scheduling
  • 3rd party API integrations
  • stateful workflow orchestration

Other signals

  • DGX Cloud
  • AI Infrastructure
  • GPU-optimized virtual machines
  • IaaS API integrations
  • stateful workflow orchestration
  • two-sided marketplace