Director, Engineering – Software Engineering and AI Inferencing Platforms

NVIDIA · Semiconductors · Hanoi, Vietnam +1

NVIDIA is seeking an Engineering Director to lead and scale software engineering teams in Vietnam, focusing on AI Inferencing Platforms and AI data/factory initiatives. The role involves driving the design, architecture, and delivery of high-performance system software platforms, collaborating with global teams, and overseeing the development and optimization of AI delivery platforms like NIMs and Blueprints. Experience with cloud, data, accelerated computing, and managing large AI/ML product teams is required.

What you'd actually do

  1. Build, lead and scale world-class engineering teams in Vietnam, collaborating with global counterparts across system software, data science, and AI platforms.
  2. Drive the design, architecture, and delivery of high-performance system software platforms that power NVIDIA’s AI products and services.
  3. Partner with global teams across Machine Learning, Inference Services, and Hardware/Software integration to ensure performance, reliability, and scalability.
  4. Oversee the development and optimization of AI delivery platforms in Vietnam, including NIMs, Blueprints, and other flagship NVIDIA services.
  5. Engage with open-source and enterprise data and workflow ecosystems (e.g., Temporal, Gitlab DevOps Platform, RAPIDS, NeMo Curator, Morpheus) to advance accelerated AI factory, data science and data engineering workloads.

Skills

Required

  • 15+ overall years of software engineering experience
  • 6+ years in senior leadership roles
  • managing large, high-performing software teams
  • delivering complex AI/ML or data-driven products
  • cloud
  • data
  • accelerated computing technologies
  • Spark
  • Kubernetes
  • Dask
  • Python ecosystem
  • CUDA
  • collaborating with open-source communities
  • enterprise partners
  • leadership
  • communication
  • cross-functional coordination
  • strategic mindset
  • hands-on technical depth in AI, system software, or large-scale data platforms

Nice to have

  • Experience building and scaling AI/ML Inferencing platforms from concept to production.
  • GPU programming
  • CUDA optimization
  • system performance engineering
  • microservices
  • distributed systems
  • high-performance data architectures
  • Contributions to open-source projects or developer ecosystems.
  • deep learning
  • RAG
  • embeddings
  • modern text search frameworks

What the JD emphasized

  • Proven record of managing large, high-performing software teams and delivering complex AI/ML or data-driven products.
  • Experience building and scaling AI/ML Inferencing platforms from concept to production.

Other signals

  • AI Inferencing Platforms
  • AI data and factory platform initiatives
  • NIMs, Blueprints, and other flagship NVIDIA services