Senior Engineering Manager, Quality & Annotations

Handshake Handshake · Enterprise · San Francisco, CA · Engineering

Senior Engineering Manager to lead Quality and Annotations teams at Handshake AI, focusing on AI quality/evaluation tooling and the platform infrastructure for data delivery. Requires experience in AI-centric companies, managing engineering teams, and building complex systems.

What you'd actually do

  1. Lead quality engineering systems that directly improve AI output reliability, evaluation accuracy, and benchmark performance for frontier lab partners
  2. Own the annotations platform: operator workflows, tasking flows, and pipeline infrastructure that powers data delivery
  3. Build and scale an organization across two distinct technical domains, developing senior ICs and driving cross-team technical strategy
  4. Partner with internal stakeholders to prioritize platform investments that unlock other teams to move faster and build on top of shared infrastructure

Skills

Required

  • 7+ years of engineering experience
  • 3+ years managing engineering teams of 8 or more
  • Experience manager managers
  • Background at companies where AI is the core product
  • Shipped in environments where model quality, data pipelines, and evaluation rigor are table stakes
  • Strong product engineering instincts
  • Experience leading teams with meaningfully different technical focuses simultaneously
  • Track record of developing engineers
  • Strong prioritization and stakeholder management
  • Clear, direct communicator

Nice to have

  • Familiarity with LLM evaluation, quality pipelines, or applied AI tooling
  • Experience with annotation or data labeling platforms, tasking systems, or workflow orchestration

What the JD emphasized

  • Background at companies where AI is the core product; you've shipped in environments where model quality, data pipelines, and evaluation rigor are table stakes
  • Track record of developing engineers; you've grown senior ICs, EMs, and leads, not just delivered projects

Other signals

  • Leading two core engineering teams focused on AI quality and annotations.
  • Building and scaling an organization of ~15 engineers.
  • Owning the annotations platform and quality engineering systems for AI output reliability.