Senior Data Scientist - Alt Defense

Roblox Roblox · Consumer · San Mateo, CA · Data Science

Senior Data Scientist role focused on developing and improving Roblox's Alt Detection system, which involves large-scale identity modeling on a massive graph. The role requires defining, measuring, and enhancing detection systems by integrating diverse signals, calibrating thresholds, identifying new behavioral/network/biometric signals, designing processing systems, leading cross-functional integration, conducting research on alt creation incentives, and communicating insights to leadership. The work is critical for safety, systemic growth, and creator incentives.

What you'd actually do

  1. Develop ground truth evaluation strategies by integrating diverse signals, ranging from "gold standard" manual labels to automated weak supervision frameworks.
  2. Calibrate score thresholds across applications, balancing high-precision enforcement needs with high-recall required for growth reporting
  3. Partner with MLE to identify and validate new behavioral, network, and biometric signals to expand detection coverage.
  4. Collaborate with Engineering to design modular systems capable of processing billions of candidate pairs and supporting high-concurrency graph traversals.
  5. Lead the cross-functional integration of identity models into Discovery, Ads, and Creator Success to eliminate fraud and improve the fidelity of platform metrics.

Skills

Required

  • 8+ years of industry experience in data science, economics, analytics, or machine learning engineering
  • 6+ years of experience using scripting languages (Python, R), and big data query/processing languages and tools such as SQL, Hive, Spark, and Airflow
  • Knowledge of ML and Deep Learning either via formal training or industry experience
  • Ability to apply creative first-principles reasoning to solve ambiguous problems
  • Experience developing large-scale safety or moderation systems as well as experience with content platforms, specifically user-generated content
  • Advanced Degree and/or PhD in Statistics, Computer Science, Physics, Applied Math, Economics, or other related quantitative fields

What the JD emphasized

  • ground truth evaluation strategies
  • high-recall required for growth reporting
  • statistically sound ground truth and measurement frameworks

Other signals

  • identity modeling
  • large-scale graph
  • alt detection systems
  • safety enforcements
  • growth reporting
  • creator incentives
  • fraud elimination
  • platform metrics fidelity