Staff Software Engineering, Genai Applications, Youtube

Google Google · Big Tech · San Bruno, CA +1

Staff Software Engineer at Google's YouTube GDA team, focusing on building and architecting the semantic layer for Generative AI applications like YouTube SQL Assistant and Debugger. The role involves designing RAG systems, optimizing context retrieval, leading embedding strategy evaluation and fine-tuning, building data pipelines for semantic indexing, and collaborating with research teams.

What you'd actually do

  1. Design and implement dynamic context construction strategies for RAG (Retrieval Augmented Generation) systems.
  2. Solve challenges related to limited context versus massive schema documentation, optimizing for precision, recall, and cost.
  3. Lead the evaluation and fine-tuning of embedding strategy (dense, sparse, and hybrid) to capture domain-specific YouTube terminology. You will decide how we represent data tables, column definitions, and debug logs in vector space.
  4. Build data pipelines that keep our semantic index fresh in real-time as YouTube’s data schemas evolve.
  5. Mentor Senior Engineers, drive technical roadmap planning, and collaborate with partners in Google DeepMind and YouTube infrastructure to adopt research.

Skills

Required

  • software development
  • software design and architecture
  • machine learning algorithms and tools
  • artificial intelligence
  • deep learning
  • natural language processing
  • data structures and algorithms
  • large-scale projects
  • context retrieval systems for large language models
  • SQL
  • vector space models
  • semantic search
  • embedding techniques

Nice to have

  • TensorFlow
  • Google DeepMind collaboration
  • YouTube infrastructure collaboration

What the JD emphasized

  • 8 years of experience in software development
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture
  • 5 years of experience with machine learning algorithms and tools (e.g. TensorFlow), artificial intelligence, deep learning, or natural language processing
  • Experience designing and implementing complex context retrieval systems (context scaffolding) for large language models in production

Other signals

  • LLM applications
  • RAG systems
  • semantic layer
  • embedding strategy
  • data pipelines for semantic index