Engineering Manager, Ai/ml Networking

Google Google · Big Tech · Raleigh, NC +2

Manage a team developing next-generation AI/ML networking solutions and Smart NICs, focusing on the hardware-software interface for AI training and inference transport layers, and dataplane encryption. The role involves leading software development in C++ for these solutions, aligning strategy, and ensuring projects move from development to production.

What you'd actually do

  1. Manage and lead the team that is developing the next generation Artificial Intelligence (AI) and Machine Learning (ML) Networking solutions as well as Smart Network Interface Cards (NICs) at Google, taking the projects through development into production.
  2. Set and communicate team priorities that support the broader organization's goals.
  3. Enable the team to advance new approaches to leverage offloads efficiently with Google hardware and software.
  4. Guide the team to build and test software in C++ for use on Google's Machine Learning (ML) Library solutions and Smart Network Interface Cards (NICs).
  5. Align strategy, processes, and decision-making across teams.

Skills

Required

  • software development
  • developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture
  • technical leadership role
  • people management or team leadership role
  • developing software applications using the C++ programming language

Nice to have

  • Nvidia Collective Communications Library (NCCL)
  • Nvidia Index Library (NIXL)
  • Deep Learning Execution Provider (DeepEP)
  • Mooncake

What the JD emphasized

  • AI Training and Inference Transport Layers
  • Smart Network Interface Cards (NICs)
  • Google's Machine Learning (ML) Library solutions
  • Smart Network Interface Cards (NICs)