Senior Data Scientist - App Performance

Roblox Roblox · Consumer · San Mateo, CA · Data Science

Senior Data Scientist focused on App Performance at Roblox, aiming to improve user experience and engagement by analyzing and optimizing app performance metrics. This role involves defining success metrics, understanding performance trade-offs, analyzing large datasets, operationalizing monitoring tools, and using A/B experiments and causal inference to evaluate feature launches. The goal is to enhance the reliability and performance of the Roblox app across various devices.

What you'd actually do

  1. Define and measure success metrics for App performance. Determine which performance metrics matter to end users and how app performance impacts user engagement and monetization.
  2. Establish an understanding of the trade-offs between different performance levers and use these insights to influence strategies, ensuring right-sized investments that optimize business growth and user experience.
  3. Access raw data, transform it, analyze it, and present it in a compelling and understandable way. Perform deep dives to uncover new insights and opportunities.
  4. Operationalize and scale metrics monitoring by building tools that enable quick slicing and dicing of data as well as root cause analysis. Collaborate with engineers to detect and investigate abnormal trends, identifying opportunities for improvement.
  5. Use A/B experiments and causal inference methods to evaluate the success of feature launches.

Skills

Required

  • Advanced degree or equivalent experience in Statistics, Applied Math, Physics, Engineering, Computer Science, Economics, or a related quantitative field.
  • 5+ years of industry experience in a data science role, preferably with a background in app and system performance.
  • Strong experience working with large datasets and proficiency in SQL, R/Python, and data visualization tools.
  • Deep knowledge and practical application of statistical methods, causal inference techniques, and experimental design.
  • Ability to drive an area as an individual contributor and thought leader.
  • Ability to apply creative, first-principles reasoning to solve ambiguous problems.
  • Strong communication skills to present analytics results and data storytelling effectively, influencing engineering teams and leaders.

Nice to have

  • Passionate about data.
  • Highly self-driven.
  • Strong communicator.
  • Capable statistician.
  • Expert transforming data with SQL and a scripting language such as Python or R.
  • Experienced in developing models to draw insights from data.

What the JD emphasized

  • app and system performance
  • large datasets
  • SQL, R/Python
  • statistical methods
  • causal inference techniques
  • experimental design
  • ambiguous problems
  • data storytelling