Abuse Investigator

OpenAI OpenAI · AI Frontier · San Francisco, CA · Intelligence & Investigations

This role focuses on investigating and mitigating malicious uses and activities on OpenAI's platform, particularly concerning violent attacks, terrorism, and other harmful behaviors. The investigator will develop abuse signals, improve operational workflows, and work with technical teams to enhance data and tooling. The role involves responding to time-sensitive escalations, supporting on-call duties, and communicating findings to stakeholders. While the company is AI-focused, this specific role is centered on abuse investigation and policy enforcement, rather than direct AI/ML model development or research.

What you'd actually do

  1. Review leads, investigate activity and disrupt abusive operations in partnership with our policy, legal, and integrity teams focused on violent and terrorist activities, especially associated with time sensitive threat to life risks
  2. Develop abuse signals and tracking strategies to help proactively detect harmful activity on our platform
  3. Identify operational workflow improvements and processes that expedite work while still mitigating risk
  4. Communicate investigation findings from your work with stakeholders internally and, at times, externally
  5. Develop a categorical understanding of our products and data, and work with technical teams to improve our data and tooling
  6. Support an on-call process and role that requires rapid threat triaging, investigation, mitigation, sound judgement and concise briefing to senior leadership

Skills

Required

  • SQL
  • Python
  • counterterrorism expertise
  • threat actor investigation
  • risk mitigation
  • policy enforcement
  • technical investigations
  • communication
  • judgment
  • on-call support

Nice to have

  • speaking another language

What the JD emphasized

  • expert understanding of our products and data
  • experience investigating threat actors
  • deep domain-specific expertise in identifying, understanding, and mitigating risk from violent attacks and behavior, and terrorist-related activity
  • experience investigating sophisticated and harmful threats
  • proven ability to quickly learn new processes, systems and team dynamics while thriving in ambiguous, rapidly changing, and high-pressure environments
  • resolving urgent escalations outside of normal work hours and on-call shift work
  • strong resiliency in managing similar high stress environments in the past
  • deep expertise in counterterrorism and violent activity mitigation
  • strong familiarity with technical investigations, especially using SQL and Python
  • at least 12+ years of experience tracking or assessing threat actors in counterterrorism and/or violent activity domains, or conducting professional casework involving violent offenders, extremist actors, or high-risk individuals
  • at least two years of experience helping to develop automated approaches to accomplishing your work