About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram, and WhatsApp further empowered billions of people around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics. About the job The Global Operations Integrity Operations Team strives to create a safe atmosphere for the Meta communities by way of effective support, education, and care for the various people around the world who use our platforms. We pride ourselves in helping prevent online and real-world harm by building fast, scalable support systems to address safety-related incidents on our product, and by influencing others to collaborate on cross-functional initiatives. As Meta continues to build AI that augments and improves upon scaled human review, the role of human experts is critical to provide the oversight, governance, and authoritative judgment that keeps those systems accurate, accountable, and aligned to policy. This role sits at the center of that shift. You will act as a human expert and decision-maker on the hardest and highest-stakes cases, and you will govern human review measurements as well as how AI and ML models make decisions across integrity and support use cases, setting the standards, guardrails, and human-in-the-loop checks that determine when a model can act on its own and when a human must weigh in. You will own the expert-labelled data and adjudication that trains, evaluates, and calibrates these models, ensuring their accuracy and relevance across both integrity and support. Those who join our teams are passionate about solving people's issues, are committed to improving the experience for Facebook and Instagram communities, and are energized by shaping how AI is trusted to act on their behalf.
Responsibilities
Serve as a human expert and final decision-maker on ambiguous, high-severity, and precedent-setting cases, and adjudicate escalations involving potentially abusive content or real-world threats Own AI oversight and governance for integrity and support decision-making: define how AI and ML models are reviewed, audited, and held accountable, and set the human-in-the-loop and human-out-of-the-loop thresholds that govern when models can act autonomously Establish and steward expert-labelled ("golden") datasets used to train, evaluate, and calibrate AI/ML models, owning label quality, precision/recall, model-agreement measurement, and drift over time Define and enforce governance frameworks (quality standards, guardrails, and escalation paths) that ensure model decisions and data labels comply with all policy, regulatory, and legal requirements Analyze and audit model and operational data to identify user trends, malicious actor behavior, systematic model errors, and coverage gaps, and translate findings into recommendations that improve enforcement accuracy at scale Partner with Engineering, Data Science, and Product to improve labeling interfaces, oversight tooling, and the mechanisms by which human judgment feeds back into model performance Become a recognized expert in integrity and support issues across operations at Meta and how they affect our community Build cross-functional partnerships to create better, more trustworthy AI-driven solutions for our community and users
Qualifications
Currently has, or is in the process of obtaining a Bachelor's degree in a directly related field, or equivalent practical experience. Degree must be completed prior to joining Meta Bachelor's degree (B.A./B.S.) 4+ years of experience in an operations, technology, management consulting, or an equivalent environment 4+ years of experience in a role involving strategic/analytical initiatives (project management, consulting, data analysis, or technical systems) and/or customer operations Experience in owning quality, decision-making, or oversight processes, setting standards and exercising authoritative judgment on complex cases Experience communicating with a variety of audiences, including engineering, data science, and technical teams Demonstrable experience using sound judgment and exhibiting Demonstrable experience using sound judgment and maintaining composure when prioritizing competing demands based on impact and urgency Familiarity with AI governance, trust and safety, or content/integrity policy Knowledge of programming languages such as Python, R, or SQL Experience with AI/ML oversight, human-in-the-loop workflows, model evaluation, or annotation/labeling quality Strategic thinker with strong analytical and problem-solving skills 2+ years of experience working with data tools such as SQL, SAS, and data visualization (e.g., Tableau) tools Familiarity with Meta's family of products and their user experience