Staff Software Engineer, Agentic Data and Evals

Google Google · Big Tech · Sunnyvale, CA +1

Staff Software Engineer focused on building and launching tools and solutions for GenAI data generation and evaluations. The role involves developing a self-service data generation platform that supports pre-training, post-training, and evaluation infrastructure, with a focus on LLM/GenAI model evaluations and fine-tuning using techniques like RLHF.

What you'd actually do

  1. Deliver and launch tools/solutions to collect, verify and deliver data/evaluations for a variety of GenAI use cases, including evaluation and improvement of Generative AI models and launches.
  2. Learn novel GenAI use cases to learn their data needs and identifying solutions leveraging the AI Data Platform.
  3. Work cross-functionally with Data Science, Product, User Experience/User Experience Research (UX/UXR) and Operations teams.
  4. Design, develop, test, deploy, maintain, and enhance large-scale software solutions.
  5. Manage project priorities, deadlines, and deliverables.

Skills

Required

  • software development
  • design
  • architecture
  • testing
  • launching software products
  • full stack development
  • back-end development (Java, Python, Golang, or C++)
  • front-end development (JavaScript, TypeScript, HTML, CSS)
  • cross-functional project experience

Nice to have

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field
  • data structures and algorithms
  • technical leadership
  • project teams leadership
  • setting technical direction

What the JD emphasized

  • evaluation and improvement of Generative AI models
  • evaluations infrastructure
  • GenAI data generation
  • evaluations

Other signals

  • GenAI data generation platform
  • LLM/GenAI model evaluations
  • model fine-tuning
  • RLHF techniques
  • self-service data generation platform
  • evaluations infrastructure