Research Engineer / Scientist, Societal Impacts

Anthropic Anthropic · AI Frontier · San Francisco, CA · AI Research & Engineering

Research Engineer/Scientist focused on designing and building infrastructure to study the societal impacts of AI systems, enabling research, policy, and product improvements. This role involves creating scalable systems for experiments, analysis, and monitoring, with a strong emphasis on collaboration and shipping impactful changes.

What you'd actually do

  1. Design and implement scalable technical infrastructure that enables researchers to efficiently run experiments and evaluate AI systems.
  2. Architect systems that can handle uncertain and changing requirements while maintaining high standards of reliability
  3. Lead technical design discussions to ensure our infrastructure can support both current needs and future research directions
  4. Partner closely with researchers, data scientists, policy experts, and other cross-functional partners to advance Anthropic’s safety mission
  5. Interface with and improve our internal technical infrastructure and tools

Skills

Required

  • Python
  • clean, well-documented code
  • technical decisions with incomplete information
  • high engineering standards
  • getting up-to-speed quickly on unfamiliar codebases
  • working well with other engineers with different backgrounds
  • using technical infrastructure to interface effectively with machine learning models
  • deriving insights from imperfect data streams
  • building systems and products on top of LLMs

Nice to have

  • large, foundational infrastructure maintenance
  • maturing tooling platforms
  • simple interfaces for non-technical collaborators
  • prioritizing requests from a wide variety of stakeholders
  • distributed systems
  • designing for scale and reliability
  • scaling and optimizing tool performance
  • product management
  • full-stack product engineering
  • zero-to-one work in startup environments
  • owning products end-to-end
  • research relating to societal impacts of technology

What the JD emphasized

  • running & designing experiments relating to machine learning systems
  • building data processing pipelines
  • architecting & implementing high-quality internal infrastructure
  • working in a fast-paced startup environment
  • navigating the ambiguity inherent to novel empirical research
  • eagerness to develop their own research & technical skills
  • running experiments
  • developing new tools & evaluation suites
  • working cross-functionally across multiple research and product teams
  • striving for beneficial & safe uses for AI
  • Experience working ambiguous AI research projects
  • Experience building and maintaining production-grade internal tools or research infrastructure
  • Track record of using technical infrastructure to interface effectively with machine learning models
  • Have experience deriving insights from imperfect data streams
  • Experience building systems and products on top of LLMs
  • Experience maintaining large, foundational infrastructure
  • Experience incubating and maturing tooling platforms used by a wide variety of stakeholders
  • Experience building simple interfaces that allow non-technical collaborators to evaluate AI systems
  • Experience with distributed systems and designing for scale and reliability
  • Experience scaling and optimizing the performance of tools
  • Experience with product management and/or full-stack product engineering, with a track record of zero-to-one work in startup (or startup-like environments) and owning products end-to-end
  • Research relating to the societal impacts of technology

Other signals

  • design and build critical infrastructure that enables and accelerates foundational research into how our AI systems impact people and society
  • ship changes that help improve our models and products based on the empirical research the Societal Impacts team is conducting
  • Design and implement scalable technical infrastructure that enables researchers to efficiently run experiments and evaluate AI systems
  • Partner closely with researchers, data scientists, policy experts, and other cross-functional partners to advance Anthropic’s safety mission
  • Generate net-new insights about the potential societal impact of systems being developed by Anthropic