Software Development Engineer - AI Frameworks, GPU Sw Performance

AMD AMD · Semiconductors · Beijing, China · Engineering

Software Development Engineer focused on optimizing AI frameworks and GPU kernels for AMD GPUs, involving deep learning framework enhancement, kernel development, model optimization (quantization), and collaboration with internal teams and open-source communities.

What you'd actually do

  1. Optimize Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open-source repositories.
  2. Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations.
  3. Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance.
  4. Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs.
  5. Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream.

Skills

Required

  • C++ programming
  • Python programming
  • Deep learning frameworks (PyTorch, vLLM, SGLang)
  • GPU kernel development and optimization
  • Model optimization (quantization)
  • Understanding of LLMs, MoE, diffusion models

Nice to have

  • HIP, CUDA, assembly (ASM)
  • AMD architectures (GCN, RDNA)
  • Compute Kernel (CK), CUTLASS, Triton
  • Profiling and benchmark tooling for large models
  • Low-precision quantization (MXFP4, FP8, INT4)
  • Sparsity

What the JD emphasized

  • optimize frameworks
  • optimize GPU kernels
  • optimize deep learning models
  • optimize training and inference performance
  • optimize performance

Other signals

  • Optimizing deep learning frameworks for AMD GPUs
  • Developing and optimizing GPU kernels for AI operations
  • Collaborating with AI researchers and open-source maintainers