Software Engineer Iii, Ai/ml Cloud

Google Google · Big Tech · Warsaw, Poland

Software Engineer III, AI/ML Cloud role at Google, focusing on building and deploying scalable AI/ML platform capabilities for Google Cloud customers. The role involves engineering solutions for LLM serving and tuning, ensuring reliability, performance, and quality, and implementing guardrails and safety gates for the Vertex AI organization. It requires experience in ML infrastructure, model deployment, and potentially speech/audio or reinforcement learning.

What you'd actually do

  1. Engineer and deploy scalable, user-friendly AI/ML platform capabilities that power the next generation of AI.
  2. Design, implement and deploy solutions that guarantee the reliability, performance and quality of our AI offerings and serving stack.
  3. Define safeguards, control and quality gates for the development and release process of the whole Vertex First-Party (1P) product set.
  4. Solve intricate, ambiguous problems that span multiple teams, making an impact on the platform's resilience.
  5. Reduce technical chaos by establishing best practices, improving system architecture across multiple components, and fostering a culture of high availability and performance optimization at scale.

Skills

Required

  • software development
  • Speech/audio
  • reinforcement learning
  • ML infrastructure
  • model deployment
  • model evaluation
  • optimization
  • data processing
  • debugging

Nice to have

  • data structures
  • algorithms
  • design and architecture
  • testing/launching software products
  • building and developing large-scale infrastructure
  • C++
  • Python

What the JD emphasized

  • AI/ML platform capabilities
  • LLM Serving and Tuning
  • reliability, performance and quality of our AI offerings and serving stack
  • guardrails and safety gates
  • ML infrastructure

Other signals

  • AI/ML platform capabilities
  • LLM Serving and Tuning
  • ML infrastructure
  • reliability, performance and quality of AI offerings
  • guardrails and safety gates