Oversight Operations Investigator

Meta Meta · Big Tech · Menlo Park, CA

This role focuses on managing high-priority escalations where AI reaches its limits, requiring expert human judgment. The investigator will design how humans and AI work together, evaluate AI outputs, encode expertise into scalable systems, and contribute to operational improvements. Key responsibilities include driving complex investigations, coordinating cross-functionally, synthesizing executive communications, and translating human judgment into AI-executable logic. The role involves designing AI-assisted workflows, testing AI capabilities, and providing feedback on AI launches, with a strong emphasis on evaluating AI-generated assessments and identifying AI failures.

What you'd actually do

  1. Drive Meta's highest-priority escalations to resolution: from initial triage through investigation, cross-functional coordination, and final resolution, ensuring that time-sensitive cases are mitigated within SLA and with minimal business or reputational impact
  2. Conduct rigorous, multi-system investigations: connect signals across surfaces and stakeholders on complex or novel case types (LLM hallucinations, AI agent misbehavior, deepfake/synthetic media, cross-platform integrity failures), producing root cause analysis and documentation that prevents recurrence
  3. Coordinate across Policy, Legal, Engineering, Sales, Communications, Leadership, and other external-facing networks: drive aligned response strategies on cases carrying reputational, legal, or business risk, translating complexity into clear decisions and accountable next steps
  4. Synthesize and deliver executive-level communications: leverage AI to ensure accurate, actionable situational awareness reaches leadership and partners when it matters
  5. Exercise judgment on unprecedented situations: make high-stakes calls and set a precedent for continuous improvement

Skills

Required

  • Investigate complex, sensitive, and time-critical escalations
  • Coordinate cross-functionally with various teams (Policy, Legal, Engineering, etc.)
  • Synthesize and communicate complex information to executive leadership
  • Exercise judgment in ambiguous and unprecedented situations
  • Design and iterate on AI-assisted workflows (prompts, decision trees, runbooks, automations)
  • Critically evaluate AI outputs and identify failure patterns
  • Translate expert human judgment into encodable logic for AI systems
  • Test and validate new AI capabilities
  • Provide structured feedback on AI launches
  • Develop and maintain deep domain expertise
  • Monitor workflow health and flag performance drift

Nice to have

  • Experience with on-call shifts in a global team
  • Experience in regulatory compliance or risk management
  • Experience with AI safety and guardrails

What the JD emphasized

  • AI product failures
  • AI agent misbehavior
  • LLM hallucinations
  • deepfake/synthetic media
  • AI reaches its limits
  • expert human judgment
  • Critically evaluate AI-generated assessments
  • correct and document failure patterns
  • AI failures

Other signals

  • AI agent failures
  • human-AI collaboration
  • evaluating AI outputs
  • encoding expertise into systems