Staff+ Software Engineer, Safeguards Review Tooling

Anthropic Anthropic · AI Frontier · San Francisco, CA · Safeguards (Trust & Safety)

Staff+ Software Engineer for Anthropic's Safeguards Review Tooling team. This role focuses on building internal tools and platforms for safety investigators to identify and act on harmful behavior. Responsibilities include developing investigation tooling, a platform layer for reusable APIs and data storage, scaling review through automation with Claude, and partnering with various teams to ensure effective enforcement systems. The role emphasizes building guardrails for sensitive tools, instrumenting shipped tools, and ensuring tooling evolves with privacy and data retention commitments. Experience with full-stack or platform engineering, shipping internal tools, and cross-functional collaboration is required. Preferred qualifications include experience with trust and safety tooling, privacy/compliance constraints, integrating LLMs/agentic systems, and building developer platforms.

What you'd actually do

  1. Build investigation, review, and enforcement tooling for both first-party and third-party platform surfaces — including case queues, investigation views, decision and audit logging, and account-actioning workflows
  2. Develop the platform layer of reusable APIs, data storage, and backend services that lets new review workflows be stood up quickly and safely
  3. Scale review through automation, including enabling reviewers to use Claude effectively and building toward Claude-assisted and Claude-driven review workflows
  4. Partner with policy, operations, legal, privacy, and data science stakeholders to translate enforcement and investigation needs into reliable, well-designed systems that measurably reduce handling time and decision error
  5. Build in the guardrails that sensitive internal tools require: granular permissions, audit trails, data-access controls, and reviewer wellbeing features such as content obfuscation and exposure limits

Skills

Required

  • technical background in full-stack or platform engineering
  • ability to engage deeply in architecture and design discussions
  • Experience shipping internal tools or platforms with demanding operational users
  • track record of improving their workflows measurably
  • Experience working cross-functionally with non-engineering partners such as operations, policy, or legal teams
  • Excellent communication skills
  • ability to explain technical tradeoffs to non-technical stakeholders
  • Care about the societal impacts of AI

Nice to have

  • 8+ years of industry software engineering experience
  • Experience building trust and safety, integrity, fraud, or abuse-prevention tooling, or other systems supporting human review at scale
  • Experience designing systems under strict privacy, compliance, or data governance constraints, such as zero data retention environments
  • Experience integrating LLMs or agentic systems into operational workflows, or building human-in-the-loop automation — including using agentic coding tools (e.g., Claude Code) as a core part of your own development workflow
  • Experience building developer platforms or extensible tooling frameworks that other teams build on top of
  • Experience supporting enforcement or moderation systems across multiple product surfaces, including enterprise or cloud platform contexts
  • A product-minded approach to internal users

What the JD emphasized

  • foundational role
  • first engineers on this new team
  • own the tools
  • platform underneath those tools
  • scale review through automation
  • Claude meaningfully extends what human reviewers can do
  • keeping people in the loop where their judgment matters most
  • speed, clarity, and reliability of this tooling directly determines how quickly Anthropic can identify harmful behavior, make sound enforcement decisions, and feed signal back into model training
  • partner closely with policy, operations, data science, legal, and privacy teams
  • ensure our enforcement systems are effective, accurate, and trustworthy
  • demanding operational users
  • track record of improving their workflows measurably
  • Experience working cross-functionally with non-engineering partners
  • Excellent communication skills
  • explain technical tradeoffs to non-technical stakeholders
  • Care about the societal impacts of AI
  • want your work to make powerful systems safer
  • Experience building trust and safety, integrity, fraud, or abuse-prevention tooling
  • systems supporting human review at scale
  • Experience designing systems under strict privacy, compliance, or data governance constraints
  • zero data retention environments
  • Experience integrating LLMs or agentic systems into operational workflows
  • building human-in-the-loop automation
  • using agentic coding tools (e.g., Claude Code) as a core part of your own development workflow
  • Experience building developer platforms
  • extensible tooling frameworks
  • Experience supporting enforcement or moderation systems across multiple product surfaces
  • enterprise or cloud platform contexts
  • product-minded approach to internal users
  • work directly with the people using your tools
  • watch where they struggle, and fix it

Other signals

  • building systems where Claude meaningfully extends what human reviewers can do
  • building toward Claude-assisted and Claude-driven review workflows
  • integrating LLMs or agentic systems into operational workflows