Data Operations Manager

Anthropic Anthropic · AI Frontier · AI Research & Engineering

Anthropic is seeking a Data Operations Manager to manage human data projects that improve AI models. The role involves scoping, executing, and managing data collection projects, ensuring high-quality human feedback data is gathered to build more capable, safer, and helpful AI systems. This includes project management, operations support, vendor coordination, quality oversight, task development, data analysis, and cross-functional collaboration.

What you'd actually do

  1. Manage end-to-end human data collection projects across multiple research teams, from scoping and planning to execution and quality control
  2. Work closely with researchers to understand their data needs, translate requirements into clear project specifications, and provide regular updates on project progress
  3. Write clear labeling instructions, review data, balance quality/diversity/volume requirements, and improve processes for efficiency
  4. Manage day-to-day relationships with external vendors and contractors for human data projects, ensuring they deliver high-quality results on time
  5. Implement systematic quality controls and verification processes to ensure data usability and trustworthiness

Skills

Required

  • Exceptional project management skills
  • Strong organizational skills
  • Excellent written and verbal communication skills
  • Experience with data collection, labeling, or analysis in technical environments
  • Strong problem-solving abilities
  • Experience with data analysis
  • Experience with tools like SQL, Python, Tableau, spreadsheets, or similar

Nice to have

  • Experience with human data collection and labeling specific to large language models
  • Knowledge of data collection, annotation, or labeling practices
  • Experience managing vendor relationships or external contractors
  • Experience implementing quality control systems for data collection
  • Background in a research-oriented organization
  • Experience with prompt engineering or working with large language models

What the JD emphasized

  • human data collection
  • AI safety