Research Scientist, Societal Impacts

Anthropic Anthropic · AI Frontier · San Francisco, CA · AI Research & Engineering

Research Scientist focused on analyzing real-world usage patterns of Claude, building evaluations to assess its behavior against its Constitution (safety, quality of advice), and partnering with fine-tuning, safeguards, policy, and interpretability teams to translate insights into model improvements. The role also involves generating insights on societal impacts to inform company strategy and policy, and sharing work through publications and presentations.

What you'd actually do

  1. Using observational tools like Clio to analyze real-world usage patterns and surface insights about how people interact with Claude.
  2. Building and running evaluations to assess Claude's behavior across key dimensions of its [Constitution](https://www.anthropic.com/news/claudes-constitution), such as safety and quality of advice in high-stakes situations.
  3. Partnering closely with fine-tuning, safeguards, policy, and interpretability teams to translate research insights into model improvements.
  4. Generating insights about the societal impact of Anthropic's systems and using this understanding to inform company strategy, research priorities, and policy positions.
  5. Sharing your work through research publications and external presentations, and developing tools and frameworks that make AI systems more understandable to policymakers, academics, and civil society.

Skills

Required

  • experience working with machine learning systems
  • comfortable with technical infrastructure for interfacing with models
  • interest in societal impacts research
  • adaptable and collaborative
  • able to take direction and contribute to team priorities
  • skilled at writing up and communicating results
  • partner with colleagues across teams on large-scale projects
  • background in machine learning, data science, or another technical field that involves generating insights from complex systems
  • passionate about translating research insights into actionable recommendations for improving AI systems and informing policy
  • willing to do hands-on work while also helping shape research direction
  • interested in management opportunities

Nice to have

  • prior experience in societal impacts research is a plus
  • may be interested in management opportunities down the line

What the JD emphasized

  • societal impacts research
  • societal impacts research
  • fine-tuning
  • safeguards
  • policy
  • interpretability
  • societal impact
  • company strategy
  • research priorities
  • policy positions
  • research publications
  • external presentations
  • AI systems
  • policymakers
  • academics
  • civil society
  • machine learning
  • data science
  • complex systems
  • AI systems
  • policy
  • hands-on work
  • shaping research direction
  • management opportunities

Other signals

  • analyzing real-world usage patterns
  • building and running evaluations
  • translating research insights into model improvements
  • sharing work through publications
  • developing tools and frameworks