Senior Software Engineer, Ai/ml, Geo and Gemini App

Google Google · Big Tech · New York, NY +1

Senior Software Engineer role focused on building and evaluating AI/ML systems, specifically agentic workflows and LLM-based features for Google Geo products. The role involves developing context engineering pipelines, analyzing model behavior, enhancing serving and evaluation infrastructure, and bridging technical teams.

What you'd actually do

  1. Build context engineering pipelines, agentic workflows with tool usage, and robust evaluation frameworks.
  2. Analyze model behavior, creating high-quality evaluation datasets to identify weaknesses and guide performance improvements.
  3. Enhance serving and evaluation infrastructure to power new user-facing features.
  4. Act as a technical bridge between engineering, product, UX, and research teams to translate user needs into valuable features.
  5. Analyze user metrics and model outputs to enhance personalization and overall system helpfulness.

Skills

Required

  • C++
  • distributed systems
  • software design and architecture
  • Large Language Models (LLMs)
  • Generative AI concepts
  • prompt engineering
  • retrieval-augmented generation (RAG)
  • model quality optimization

Nice to have

  • data structures and algorithms
  • technical leadership
  • data analysis
  • experimental design
  • statistical methods
  • TensorFlow
  • JAX
  • PyTorch
  • user metrics logging
  • A/B testing

What the JD emphasized

  • Experience with Large Language Models (LLMs) and Generative AI concepts
  • Experience with model quality optimization

Other signals

  • building agentic workflows
  • evaluating LLMs
  • enhancing serving infrastructure