Senior Software Engineer, Cloud Ai/ml Infrastructure

Google Google · Big Tech · Taipei, Taiwan

Senior Software Engineer role focused on optimizing AI/ML infrastructure performance for training and inference workloads, developing tools for end-to-end developer experience, and collaborating with cross-functional teams to ensure exceptional value delivery. The role involves identifying and resolving performance bottlenecks and shaping the future of AI/ML infrastructure.

What you'd actually do

  1. Optimize performance across the AI infrastructure technical stack through in-depth performance profiling, debugging, and troubleshooting of AI/ML training and inference workloads.
  2. Develop tools and software for our AI/ML Infrastructure to deliver end-to-end developer experience.
  3. Collaborate with cross-functional, cross-regional teams to ensure AI/ML infrastructure delivers exceptional value and drives success for customers.
  4. Identify and resolve performance bottlenecks to maintain infrastructure that operates at peak capacity.
  5. Shape the future of AI/ML infrastructure by identifying gaps in the existing products and recommending enhancements.

Skills

Required

  • software development
  • software design and architecture
  • testing, maintaining, or launching software products

Nice to have

  • Generative AI
  • Large Language Models (LLM)
  • machine learning infrastructure
  • model deployment
  • performance optimization
  • profiling
  • debugging
  • distributed computing
  • GPUs or TPUs
  • scoping and solving ambiguous problems
  • technical leadership
  • cross-functional and cross-regional team collaboration

What the JD emphasized

  • AI/ML training and inference workloads
  • performance profiling, debugging, and troubleshooting
  • distributed computing leveraging GPUs or TPUs
  • Generative AI, Large Language Models (LLM), or machine learning infrastructure

Other signals

  • AI/ML infrastructure
  • performance optimization
  • training and inference workloads
  • distributed computing
  • GPUs or TPUs