Cloud Acceleration Engineer – Dpu & AI Infra

ByteDance ByteDance · Big Tech · Seattle, WA · Infrastructure

This role focuses on designing and developing DPU network software and exploring AI/ML infrastructure acceleration, specifically for distributed training and inference. It involves software-hardware co-design and performance optimization of systems related to AI computing.

What you'd actually do

  1. Design and develop DPU network software with a focus on high performance, low latency, and reliability.
  2. Collaborate with hardware teams to build software-hardware co-design solutions for networking and storage acceleration.
  3. Explore AI/ML infrastructure acceleration, leveraging DPUs, GPUs, and custom hardware to optimize distributed training and inference.
  4. Drive end-to-end performance optimization, from OS kernels and drivers to user-space runtime systems.
  5. Contribute to architecture design, technical proposals, and long-term research directions.

Skills

Required

  • C/C++ development and debugging
  • Linux systems development experience
  • compute, network architecture, and operating systems understanding
  • software-hardware co-design OR distributed systems OR high-performance networking OR AI/ML systems background

Nice to have

  • Ph.D. in related fields with research training and publications
  • network virtualization (OVS, SR-IOV, eBPF)
  • DPDK and high-performance user-space networking
  • hardware acceleration experience, FPGA/ASIC/GPU/CUDA
  • NCCL Collectives along with AI communication patterns and parallelization techniques
  • designing and building AI/ML infrastructure related but not limited to inference kv cache system, data preprocessing system

What the JD emphasized

  • high performance
  • low latency
  • software-hardware co-design
  • AI/ML infrastructure acceleration
  • distributed training and inference
  • performance optimization

Other signals

  • DPU acceleration for AI/ML workloads
  • optimize distributed training and inference
  • software-hardware co-design