Senior Engineering Manager, Agent Context

Asana Asana · Enterprise · New York, NY · Product Engineering

Engineering Manager for the Agent Context team at Asana, focusing on the retrieval stack (search, embeddings, ranking, RAG) and evaluation infrastructure for AI systems. The role involves managing a team of senior engineers, driving technical direction, and ensuring the reliability and performance of AI experiences at enterprise scale.

What you'd actually do

  1. Own the technical direction and delivery of Asana's retrieval stack end to end: lexical and semantic search, dense embedding generation and backfill at scale, chunking and ranking strategies, and RAG comprehensiveness across the work graph.
  2. Build and operate the evaluation infrastructure that makes retrieval quality measurable recall/precision benchmarks, offline and online evals, and comparative testing across retrieval backends - so quality decisions are made with data, not vibes.
  3. Drive the cost, performance, and quality tradeoffs that define this space: when semantic search earns its infrastructure cost over lexical, how to hit latency targets without sacrificing recall, and how retrieval improvements compound into cheaper, faster downstream LLM calls.
  4. Set and enforce the bar for how other teams at Asana integrate with retrieval: clear ownership of embedding decisions, rollout guidance, metrics to watch, and a platform posture that says no to unjustified infrastructure spend.
  5. Hire, grow, and retain a team of strong senior engineers in NYC, and lead effectively across three time zones with deliberate async communication practices.

Skills

Required

  • Software engineering experience
  • Managing engineers
  • Production search, retrieval, or ML-serving systems
  • Modern retrieval stack (inverted indexes, BM25, vector search, embedding models, hybrid retrieval, chunking, re-ranking)
  • Evaluation systems for ML/AI quality (golden datasets, recall/precision metrics, LLM-as-judge, online experimentation)
  • Technical credibility to review design docs
  • Leading distributed teams across time zones
  • Clear, decisive, and frequent written communication

Nice to have

  • LLM-powered products
  • Agent systems
  • RAG pipelines in production
  • Scaling a platform team that serves internal customers

What the JD emphasized

  • 8+ years of software engineering experience with 3+ years managing engineers
  • You've shipped and operated production search, retrieval, or ML-serving systems at meaningful scale
  • Deep working knowledge of the modern retrieval stack
  • You've built or heavily used evaluation systems for ML/AI quality
  • Experience with LLM-powered products, agent systems, or RAG pipelines in production is strongly preferred

Other signals

  • Own the technical direction and delivery of Asana's retrieval stack end to end
  • Build and operate the evaluation infrastructure that makes retrieval quality measurable
  • Drive the cost, performance, and quality tradeoffs
  • Hire, grow, and retain a team of strong senior engineers
  • Partner with your PM counterpart to translate a multi-year platform thesis into a sequenced roadmap