Lead, Product Content Engineering

Meta Meta · Big Tech · Menlo Park, CA +2

Meta is seeking a Lead, Product Content Engineering to manage a team focused on evaluating and improving AI content experiences. This role involves developing strategies for LLM evaluation, leading a team of content engineers, driving sprints for LLM evaluations and tooling, and collaborating with cross-functional teams to align AI behaviors with user expectations. The position requires experience with GenAI products, prompt engineering, content evaluation, and working with ranking systems, with a focus on delivering business impact at scale in a dynamic environment.

What you'd actually do

  1. Develop and execute strategies for Meta's product teams to evaluate LLMs at scale across content work
  2. Build, lead, and mentor a team of content engineers, fostering a culture of creativity, excellence, and professional growth
  3. Drive sprints for LLM evaluations and automated evaluation tooling while devising and implementing systems to increase evaluation capacity
  4. Understand technical product needs and translate those into actionable direction for content-focused cross-functional teams
  5. Understand Meta's strategic and competitive position and deliver content strategies and product solutions that are aligned with our mission and aligned with our mission and competitive in the industry

Skills

Required

  • 10+ years of experience improving content quality and relevance on content platforms, including work with video creators, ranking systems, content strategy
  • 3+ years of professional experience in hiring, managing and developing individual contributors
  • 1+ year working with GenAI products, prompt engineering, annotation, and/or content evaluation and analysis
  • Experience driving cross-functional projects autonomously to build products, respond to urgent needs, preempt issues and address concerns in a collaborative and timely fashion
  • Familiarity with AI industry trends demonstrated through past work applying them to content strategy and the ability to translate them into actionable content strategy
  • Experience applying critical thinking to lead data-driven analyses that inform product or content decisions, and communicating findings to executive leadership
  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
  • 2+ years of experience working closely with ranking teams
  • BA or BS in Computer Science, Data Science, Linguistics, or related field
  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • 4+ years of work experience in product management, data analytics, or content operations in a large-scale content platform

Nice to have

  • Experience with data visualization tools such as Tableau
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

What the JD emphasized

  • evaluate LLMs at scale
  • managing a team
  • LLM evaluations
  • content evaluation and analysis
  • AI industry trends
  • responsible, ethical AI practices
  • ranking teams
  • AI skill development
  • integrate AI tools

Other signals

  • evaluating LLMs at scale
  • managing a team of team members
  • drive alignment across a wide cross-functional team
  • deliver business impact at scale