Roblox

Roblox is seeking a Data Scientist for their Foundation AI team, focusing on evaluating and optimizing user-facing Generative AI systems. The role involves developing evaluation frameworks, running experiments, defining success metrics, building automated systems, and conducting applied research. The ideal candidate will have a PhD, strong technical skills in SQL and Python, expertise in experimentation and causal inference, and familiarity with GenAI models and evaluation methods. Experience with model training lifecycle (fine-tuning, RLHF, synthetic data) and a track record of applied research or publications are highly valued. The role is primarily focused on the evaluation gate (L5) for GenAI features, with a secondary focus on fine-tuning and RLHF methods (L2).