Aiml - Sr Data Scientist, Evaluation

Apple Apple · Big Tech · Seattle, WA · Machine Learning and AI

This role focuses on developing and implementing evaluation methods for Siri's user-facing products, using data science and machine learning to guide product development and improve search quality. The primary focus is on evaluation and measurement, with collaboration on core ML algorithms.

What you'd actually do

  1. Research and develop evaluation methods to improve the quality of Siri’s user facing products.
  2. Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that Siri engineering will use every day.
  3. Work with large, complex data sets.
  4. Build and prototype analysis pipelines iteratively to provide insights at scale.
  5. Partner closely with Siri search engineering teams on core machine learning algorithms and systems that are part of Siri’s ability to understand and respond to requests.

Skills

Required

  • data science
  • machine learning
  • analytics
  • statistical data analysis
  • A/B testing
  • articulating and translating business questions
  • statistical techniques
  • data gathering
  • requirements specification
  • data processing
  • analysis
  • SQL
  • Spark
  • Python
  • R
  • Scala

Nice to have

  • online AB testing platform
  • designing, analyzing and interpreting experiments
  • on-device logging and metrics development
  • large language models
  • leveraging LLM for evaluation and product improvement

What the JD emphasized

  • evaluation methods
  • evaluation
  • evaluation/experimentation engineering teams
  • core machine learning algorithms and systems

Other signals

  • driving product impact via measurement and evaluation
  • guide product development, decisions and directions through principled evaluation and rigorous use of data
  • Research and develop evaluation methods to improve the quality of Siri’s user facing products
  • Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that Siri engineering will use every day
  • Partner closely with Siri search engineering teams on core machine learning algorithms and systems