Roblox

Roblox is seeking a Data Scientist for their Foundation AI team, focusing on evaluating and optimizing user-facing Generative AI systems. The role involves developing evaluation frameworks, running experiments, defining success metrics, building automated systems, and conducting applied research. The ideal candidate will have a PhD, strong technical skills in SQL and Python, expertise in experimentation and causal inference, and familiarity with GenAI models and evaluation methods. Experience with model training lifecycle (fine-tuning, RLHF, synthetic data) and a track record of applied research or publications are highly valued. The role is primarily focused on the evaluation gate (L5) for GenAI features, with a secondary focus on fine-tuning and RLHF methods (L2).

Senior Data Scientist role focused on Generative AI at Roblox, specifically on developing evaluation frameworks and automated systems for GenAI features and internal AI Agents. The role involves running experiments, defining success metrics, and driving strategy related to AI safety, quality, and efficiency for both end-users and developers. It requires strong data science skills, experimentation, causal inference, and familiarity with GenAI evaluation methods.

Roblox is seeking a Scientist/Senior Scientist for their Ads Systems team. This role focuses on designing and leading offline model evaluation, contributing to ML feature and model improvements for ads, building evaluation and simulation models, and leading experimental design and analysis. The position is crucial for innovating advertising systems and operations within a new strategic area for Roblox.

Senior Data Scientist role focused on developing and improving Roblox's Alt Detection system, which involves large-scale identity modeling on a massive graph. The role requires defining, measuring, and enhancing detection systems by integrating diverse signals, calibrating thresholds, identifying new behavioral/network/biometric signals, designing processing systems, leading cross-functional integration, conducting research on alt creation incentives, and communicating insights to leadership. The work is critical for safety, systemic growth, and creator incentives.

Roblox is seeking a Principal Data Scientist to focus on content safety and moderation. This role involves establishing and monitoring prevalence measurement methodologies, developing ground truth datasets for harmful content, conducting exploratory analysis on threat landscapes, designing and analyzing experiments for safety features, and leveraging causal inference to measure effectiveness. The scientist will collaborate with Product, Engineering, Legal, Policy, and Compliance teams, and partner with ML and Data Engineering teams to ensure statistically sound frameworks. The ideal candidate has extensive experience in data science, scripting languages, big data tools, and a background in safety or moderation systems for content platforms.