Senior Software Engineer, Ai/ml Infrastructure

Google Google · Big Tech · Bengaluru, Karnataka, India

Senior Software Engineer to work on an ML-as-a-service platform that enables Google product teams to build and launch GenAI-powered products. The role involves developing and maintaining production services, improving ML fleet efficiency, and implementing customer-requested ML/AI features, with a focus on prompt optimization, fine-tuning, and hyperparameter optimization.

What you'd actually do

  1. Develop and maintain our production service, written in C++ and Python, and further the platform vision of incorporating prompt optimization, fine tuning, hyper parameter optimization, and ML best practices into Google product development.
  2. Develop an understanding of various parts of Google’s ML training and serving stack. Influence and coach a distributed team of engineers.
  3. Identify opportunities to improve the efficiency of the ML fleet and build solutions and capabilities to improve ML fleet efficiency.
  4. Design and implement customer requested ML and AI features. From requirements-gathering and design-authoring, through implementation and landing impact in production.

Skills

Required

  • software development in C++ and Python
  • testing, maintaining, or launching software products
  • software design and architecture
  • responsible ML and ML explainability concepts and practices

Nice to have

  • Large Language Model (LLM) training and serving
  • ML frameworks
  • TPU/GPU architecture
  • Tensorflow
  • JAX
  • Keras
  • Gemax

What the JD emphasized

  • production service
  • ML training and serving stack
  • ML fleet efficiency
  • customer requested ML and AI features

Other signals

  • ML-as-a-service platform
  • GenAI-powered products
  • ML training and serving stack
  • ML fleet efficiency