Software Engineer, Ai/ml, Google Lens

Google Google · Big Tech · Mountain View, CA +1

Software Engineer role focused on building automated evaluation and telemetry pipelines for conversational AI systems within Google Lens and Search. The role involves implementing ML solutions, utilizing ML infrastructure, optimizing models, and processing data, with a focus on generative AI technologies and LLM-as-a-Judge systems. It also touches on data pipelines and production quality.

What you'd actually do

  1. Write product or system development code in languages such as Python, C++, or Java, focusing on building automated evaluation and telemetry pipelines for conversational AI systems.
  2. Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency) within a highly cross-functional environment.
  3. Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback to ensure seamless onboarding and engineering alignment.
  4. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality of conversational systems in production.
  5. Implement solutions in one or more specialized ML areas, utilize ML infrastructure, and contribute to model optimization and data processing.

Skills

Required

  • software development in Python, C++, or Java
  • building automated evaluation and telemetry pipelines
  • ML infrastructure
  • data processing
  • telemetry systems, event logging, or applying statistics within production software
  • Speech/audio, reinforcement learning, ML infrastructure, or specialization in another ML field

Nice to have

  • generative AI technologies
  • prompt engineering
  • synthetic data generation
  • LLM-as-a-Judge automated grading systems
  • building experimentation infrastructure (e.g., A/B tests, holdouts)

What the JD emphasized

  • automated evaluation and telemetry pipelines for conversational AI systems
  • conversational AI systems
  • ML infrastructure
  • data processing
  • generative AI technologies
  • LLM-as-a-Judge automated grading systems

Other signals

  • building automated evaluation and telemetry pipelines for conversational AI systems
  • implement solutions in one or more specialized ML areas
  • utilize ML infrastructure
  • contribute to model optimization and data processing
  • generative AI technologies
  • implementing LLM-as-a-Judge automated grading systems