Manager, Data and AI Engineering

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA

Manager of Data & AI Engineering role focused on building and productionizing an autonomous data intelligence platform for Supply Chain Operations, leveraging Databricks, AWS, and modern cloud-native patterns. The role involves designing scalable data and AI platforms, delivering ETL/ELT and streaming pipelines, enabling AI use cases like RAG and AI agents, and managing a high-performing team. Requires strong technical expertise in data engineering and leadership experience, with a willingness to code.

What you'd actually do

  1. Design and build scalable data and AI platforms using Databricks, AWS, and modern cloud-native engineering patterns.
  2. Deliver robust ETL/ELT, streaming, and CDC pipelines using technologies such as Spark, Kafka, Delta Lake, and AWS-native services.
  3. Enable delivery of AI-powered use cases including RAG applications, AI agents, tool-calling workflows, and data-driven web apps.
  4. Implement data quality frameworks, observability, alerting, and monitoring to ensure pipeline integrity and production reliability.
  5. Build the data foundation for GenAI, agentic AI, and advanced analytics initiatives, including RAG pipelines, vector search, knowledge graphs, and multi-agent orchestration patterns

Skills

Required

  • Data Engineering
  • Software Engineering
  • web application development
  • leadership
  • engineering management
  • Databricks
  • AWS
  • Spark
  • PySpark
  • Delta Lake
  • Databricks Workflows
  • LLMs
  • autonomous agents
  • multi-step workflows
  • ETL/ELT
  • streaming
  • CDC pipelines
  • Kafka
  • Data modeling
  • Star Schema
  • Snowflake Schema
  • Data Vault
  • data quality frameworks
  • observability
  • alerting
  • monitoring
  • RAG applications
  • AI agents
  • tool-calling workflows
  • data-driven web apps
  • vector search
  • knowledge graphs
  • multi-agent orchestration

Nice to have

  • Unity Catalog
  • Databricks Certifications
  • AWS Certifications
  • managing multi-functional teams
  • supply chain business processes

What the JD emphasized

  • Willingness to Code: You are still a builder at heart. You are excited to spend your time writing code, prototyping, and building production systems alongside your team.
  • Agentic AI & LLM Mastery: Proven experience operationalizing Large Language Models (LLMs) into autonomous agents that can plan, use tools, and implement multi-step workflows.
  • Databricks Mastery: Proven deep expertise in Apache Spark, PySpark, Delta Lake, and Databricks Workflows.

Other signals

  • build-out of our next-generation autonomous data intelligence platform
  • architecting, building, and productionize solutions
  • drive the build-out of our next-generation autonomous data intelligence platform for Supply Chain Operations