Staff Software Engineer, Agentic Data and Evals

Google Google · Big Tech · Sunnyvale, CA +1

Staff Software Engineer focused on building and launching tools and solutions for GenAI data generation and evaluations. The role involves developing a self-service data generation platform, performing LLM/GenAI model evaluations, and fine-tuning models using techniques like RLHF. The engineer will work cross-functionally to deliver high-quality data sets and evaluation infrastructure for various GenAI use cases.

What you'd actually do

  1. Deliver and launch tools/solutions to collect, verify and deliver data/evaluations for a variety of GenAI use cases, including evaluation and improvement of Generative AI models and launches.
  2. Learn novel GenAI use cases to learn their data needs and identifying solutions leveraging the AI Data Platform.
  3. Work cross-functionally with Data Science, Product, User Experience/User Experience Research (UX/UXR) and Operations teams.
  4. Design, develop, test, deploy, maintain, and enhance large-scale software solutions.
  5. Manage project priorities, deadlines, and deliverables.

Skills

Required

  • software development
  • design
  • architecture
  • testing
  • launching software products
  • full stack development
  • back-end development (Java, Python, Golang, or C++)
  • front-end development (JavaScript or TypeScript, HTML, CSS)
  • cross-functional projects

Nice to have

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field
  • data structures and algorithms
  • technical leadership role
  • project teams
  • setting technical direction

What the JD emphasized

  • launch tools/solutions
  • GenAI use cases
  • AI Data Platform
  • large-scale software solutions

Other signals

  • GenAI data generation platform
  • LLM/GenAI model evaluations
  • model fine-tuning
  • RLHF techniques
  • self-service data generation platform
  • evaluations infrastructure