Software Engineering Manager, Commerce Shopping Quality Journey Orchestration

Google Google · Big Tech · Pittsburgh, PA +1

Software Engineering Manager for the Journey Orchestration and Autorater (JOAA) team, focusing on architecting the Shopping Quality Flywheel. This role involves understanding AI quality, detecting regression root causes, and driving improvements using LLM-based autoraters as proxies for user metrics. Responsibilities include technical leadership for LLM workflows, defining team strategy, and cross-functional alignment within Google Commerce.

What you'd actually do

  1. Set and communicate team priorities that support the broader organization's goals. Align strategy, processes, and decision-making across teams.
  2. Set clear expectations with individuals based on their level and role and aligned to the broader organization's goals. Meet regularly with individuals to discuss performance and development and provide feedback and coaching.
  3. Develop the mid-term technical outlook and roadmap within the scope of your (often multiple) team(s). Evolve the roadmap to meet anticipated future requirements and infrastructure needs.
  4. Design, guide, and vet systems designs within the scope of the broader area, and write product or system development code to solve ambiguous problems.
  5. Review code developed by other engineers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).

Skills

Required

  • Software development
  • ML design
  • ML infrastructure optimization
  • technical leadership
  • GenAI techniques (LLMs, Multi-Modal, Large Vision Models)
  • people management
  • team leadership

Nice to have

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field
  • experience working in a complex, matrixed organization

What the JD emphasized

  • 5 years of experience in a technical leadership role
  • 2 years of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision)
  • 2 years of experience in a people management or team leadership role
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning)

Other signals

  • Leverage LLM-based autoraters
  • architect the Shopping Quality Flywheel
  • driving improvements through advanced response orchestration
  • direct technical leadership for complex LLM workflows