Test Data Scientist

Mistral AI Mistral AI · AI Frontier · Paris, France · Engineering & Infra

Data Scientist role at Mistral AI, focusing on analyzing user behavior, optimizing AI product performance, and designing data-driven features. The role involves defining key metrics, designing and analyzing experiments, implementing end-to-end data science projects, evaluating model performance, and ensuring data quality. Requires strong Python, SQL, statistical modeling, and machine learning skills, with a product-oriented mindset.

What you'd actually do

  1. Define key metrics, understand in-depth the performance of our AI products, and identify opportunities for improvement.
  2. Design and analyze experiments (A/B tests, causal inference) to validate hypotheses and guide product decisions.
  3. Design and implement end-to-end data science projects, from data collection and preprocessing to model building, evaluation, and deployment.
  4. Evaluate model performance in training and production, identifying edge cases, and develop frameworks to measure user satisfaction.
  5. Work with engineering to ensure data quality and accessibility for analytics and ML.

Skills

Required

  • Python
  • SQL
  • Statistical modeling
  • Machine learning algorithms
  • Experimental design
  • Causal inference
  • Data analysis
  • Product acumen
  • Communication skills

Nice to have

  • DBT

What the JD emphasized

  • Minimum of 5 years of industry experience as a Data Scientist
  • Master's or Ph.D. degree in Computer Science, Statistics, Mathematics, Engineering, or a related quantitative field
  • Proficiency in Python
  • Proficiency in SQL
  • Strong statistical intuition and experience with experimental design, causal inference and machine learning algorithms

Other signals

  • Analyze user behavior
  • Optimize product performance
  • Design data-driven features
  • Evaluate model performance
  • Ensure data quality and accessibility