Senior Technical Program Manager, Cloud Infrastructure

NVIDIA · Semiconductors · Santa Clara, CA +1

NVIDIA is seeking a Senior Technical Program Manager to join their DGX Cloud team, focusing on cloud infrastructure bring-up and management. The role involves collaborating with Cloud Service Providers (CSPs) and internal engineering teams to build and scale AI capacity and infrastructure globally. Responsibilities include defining requirements, developing roadmaps, managing operations, and ensuring adherence to processes, with an emphasis on availability, maintenance, and performance indicators. The TPM will also drive the adoption of cloud infrastructure solutions and establish KPIs to measure program impact, while proactively managing risks and fostering continuous improvement.

What you'd actually do

Working in close coordination with storage engineering and network engineering teams to define and communicate requirements to CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers). Drive alignment and a POR for capacity blocks based on workload needs.
Drive early engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers) to understand their managed storage, network solutions and influence alignment with NVIDIA Cloud roadmap
Gathering technical requirements, developing comprehensive roadmaps, establishing clear milestones, and ensuring adherence to our Product Lifecycle (PLC) process.
Managing ongoing capacity operations and the engineering engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Provider) partners, collaborating closely with engineering leads. Focus on availability, maintenance and other critical performance indicators.
Partner closely within NVIDIA to understand workload requirements and related hardware and infrastructure needs. This includes speeds and feeds to optimize infrastructure readiness with cloud vendors and NVIDIA Cloud Providers.

Skills

Required

8+ years of technical program management experience
driven the planning and execution of large-scale cloud infrastructure programs with outside organizations
focus strongly on software engineering projects within a matrixed organization
Extensive hands-on experience in cloud infrastructure, preferably gained from working at a major Cloud Service Provider (CSP)
Domain knowledge in the bring-up and end to end operations of compute, storage and GPU (including common failure points at the HW and SW levels)
Expert-level proficiency with Jira, Smartsheet, or similar program management tools
ability to expertly guide engineering teams on their use of the tools
Outstanding strategic and tactical thinking abilities
strong capacity to build consensus and drive program success
Comfort and efficiency in growing within ambiguous environments
excellent communication and technical presentation skills, particularly for executive audiences
BS or MS in Electrical Engineering or Computer Science, or equivalent experience

Nice to have

In depth knowledge of NVIDIA GPU products, including deployment and bring-up
Working knowledge of various cloud technologies (Kubernetes, API integration, Terraform, etc)
Significant experience with productivity tools and process automation is a major plus
Deep familiarity with cloud-native product / services environments and familiarity with AI, ML infrastructure, and cloud/services

What the JD emphasized

extensive background in cloud infrastructure bring-up with external partners
key role in collaborating with CSPs, emerging cloud providers and engineering teams internally to help build AI capacity and infrastructure across the globe
driving critical programs related to AI capacity enablement and management
developing and maturing foundational capabilities and processes for DGX Cloud, spanning critical areas such as cluster/capacity bring-up including CPU, storage, networking and compute requirements to support GPUs
drive early engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers) to understand their managed storage, network solutions and influence alignment with NVIDIA Cloud roadmap
Managing ongoing capacity operations and the engineering engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Provider) partners, collaborating closely with engineering leads. Focus on availability, maintenance and other critical performance indicators.
Leveraging Jira and other program management platforms to instill rigor and structure in the management of engineering deliverables.
identifying and driving opportunities to onboard the adoption of third-party and in-house cloud infrastructure solutions for deployments, support, security, compliance and observability across DGX Cloud
Establishing key performance indicators (KPIs) and quantitatively demonstrating the value and impact delivered by your programs.
Proactively identifying, resolving, and mitigating risks and issues that could affect scope, schedule, and quality across all program aspects.
Encouraging a culture of continuous improvement, consistently seeing opportunities for process improvements within our cloud infrastructure operations.
8+ years of technical program management experience. You have driven the planning and execution of large-scale cloud infrastructure programs with outside organizations. You focus strongly on software engineering projects within a matrixed organization.
Extensive hands-on experience in cloud infrastructure, preferably gained from working at a major Cloud Service Provider (CSP).
Domain knowledge in the bring-up and end to end operations of compute, storage and GPU (including common failure points at the HW and SW levels).
Expert-level proficiency with Jira, Smartsheet, or similar program management tools, with the ability to expertly guide engineering teams on their use of the tools.
Outstanding strategic and tactical thinking abilities, coupled with a strong capacity to build consensus and drive program success
Comfort and efficiency in growing within ambiguous environments.
Possess excellent communication and technical presentation skills, particularly for executive audiences.
BS or MS in Electrical Engineering or Computer Science, or equivalent experience.
In depth knowledge of NVIDIA GPU products, including deployment and bring-up
Working knowledge of various cloud technologies (Kubernetes, API integration, Terraform, etc)
A highly enthusiastic, energetic, responsive, and passionate individual with a keen eye for identifying process improvement opportunities.
Significant experience with productivity tools and process automation is a major plus.
Deep familiarity with cloud-native product / services environments and familiarity with AI, ML infrastructure, and cloud/services

Read full job description

NVIDIA's deep learning platforms are at the forefront of innovation, profoundly impacting various fields and widely adopted by leading academic institutions, startups, and major Internet companies globally. We're seeking an accomplished and highly skilled Technical Program Manager (TPM) to join our NVIDIA DGX Cloud team. This is an exciting opportunity for a passionate, results-oriented, and creative individual to deliver exceptional value to our DGX Cloud customers. We are specifically looking for a TPM with extensive background in cloud infrastructure bring-up with external partners. You will play a key role in collaborating with CSPs, emerging cloud providers and engineering teams internally to help build AI capacity and infrastructure across the globe

What you'll be doing:

As a DGX Cloud Technical Program Manager, you'll be a key partner to our Engineering, Infrastructure, Software teams and their leadership, driving critical programs related to AI capacity enablement and management. You'll play a pivotal role in developing and maturing foundational capabilities and processes for DGX Cloud, spanning critical areas such as cluster/capacity bring-up including CPU, storage, networking and compute requirements to support GPUs. This is a dynamic, fast-paced environment where TPMs are encouraged to apply fungible abilities to a range of high-impact programs within the DGX Cloud ecosystem.

Your responsibilities will include:

Working in close coordination with storage engineering and network engineering teams to define and communicate requirements to CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers). Drive alignment and a POR for capacity blocks based on workload needs.
Drive early engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Providers) to understand their managed storage, network solutions and influence alignment with NVIDIA Cloud roadmap
Gathering technical requirements, developing comprehensive roadmaps, establishing clear milestones, and ensuring adherence to our Product Lifecycle (PLC) process.
Managing ongoing capacity operations and the engineering engagement with CSP (Cloud Service Providers) and NCP’s (NVIDIA Cloud Provider) partners, collaborating closely with engineering leads. Focus on availability, maintenance and other critical performance indicators.
Partner closely within NVIDIA to understand workload requirements and related hardware and infrastructure needs. This includes speeds and feeds to optimize infrastructure readiness with cloud vendors and NVIDIA Cloud Providers.
Leveraging Jira and other program management platforms to instill rigor and structure in the management of engineering deliverables.
Identifying and driving opportunities to onboard the adoption of third-party and in-house cloud infrastructure solutions for deployments, support, security, compliance and observability across DGX Cloud
Establishing key performance indicators (KPIs) and quantitatively demonstrating the value and impact delivered by your programs.
Proactively identifying, resolving, and mitigating risks and issues that could affect scope, schedule, and quality across all program aspects.
Encouraging a culture of continuous improvement, consistently seeing opportunities for process improvements within our cloud infrastructure operations.

What we need to see:

8+ years of technical program management experience. You have driven the planning and execution of large-scale cloud infrastructure programs with outside organizations. You focus strongly on software engineering projects within a matrixed organization.
Extensive hands-on experience in cloud infrastructure, preferably gained from working at a major Cloud Service Provider (CSP).
Domain knowledge in the bring-up and end to end operations of compute, storage and GPU (including common failure points at the HW and SW levels).
Expert-level proficiency with Jira, Smartsheet, or similar program management tools, with the ability to expertly guide engineering teams on their use of the tools.
Outstanding strategic and tactical thinking abilities, coupled with a strong capacity to build consensus and drive program success
Comfort and efficiency in growing within ambiguous environments.
Possess excellent communication and technical presentation skills, particularly for executive audiences.
BS or MS in Electrical Engineering or Computer Science, or equivalent experience.

Ways to stand out from the crowd:

In depth knowledge of NVIDIA GPU products, including deployment and bring-up
Working knowledge of various cloud technologies (Kubernetes, API integration, Terraform, etc)
A highly enthusiastic, energetic, responsive, and passionate individual with a keen eye for identifying process improvement opportunities.
Significant experience with productivity tools and process automation is a major plus.
Deep familiarity with cloud-native product / services environments and familiarity with AI, ML infrastructure, and cloud/services

NVIDIA is widely considered to be one of the technology world’s most desirable employers! We offer attractive compensation and an extensive benefits package. While planning your future, explore what we provide for you and your loved ones at www.nvidiabenefits.com/ We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until May 5, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.