Software Engineer Iii, Vertex Inference

Google Google · Big Tech · Warsaw, Poland

Software Engineer III on the Vertex Inference On Hybrid Clouds team, focused on introducing AI/ML capabilities to Google Cloud. The role involves delivering dataplane components for serving first-party models like Gemini, implementing GenAI solutions, utilizing ML infrastructure, and optimizing performance. Requires experience with GenAI techniques and serving infrastructure.

What you'd actually do

  1. Implement GenAI solutions, utilize ML infrastructure, and contribute to data preparation, optimization, and performance enhancements.
  2. Write product or system development code.
  3. Collaborate with peers and stakeholders through design and code reviews to ensure best practices among available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  4. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.

Skills

Required

  • software development
  • ML infrastructure
  • GenAI techniques
  • Large Language Models (LLMs)
  • Multi-Modal
  • Large Vision Models
  • language modeling
  • computer vision

Nice to have

  • data structures
  • algorithms
  • GenAI serving infrastructure

What the JD emphasized

  • GenAI serving infrastructure

Other signals

  • Vertex Inference On Hybrid Clouds team
  • introduce AI/ML capabilities (including GenAI, MLOps, etc.) to Google Cloud
  • delivering various components of the dataplane for serving various first-party models such as Gemini
  • Implement GenAI solutions, utilize ML infrastructure, and contribute to data preparation, optimization, and performance enhancements.
  • Experience with GenAI techniques (e.g., Large Language Models (LLMs), Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
  • Experience with GenAI serving infrastructure.