New Model Behavior Architect, Multilingual

Mistral AI Mistral AI · AI Frontier · Paris, France · Research

Mistral AI is seeking a Multilingual Model Behavior Architect to define and measure effective model behavior across languages, ensuring consistency, naturalness, and cultural alignment. The role involves interacting with models, gathering feedback, defining quality standards, and designing evaluations and synthetic testing for multilingual settings. The ideal candidate has expertise in AI evaluation frameworks, linguistics, or multilingual NLP, and a track record of solving open-ended challenges.

What you'd actually do

  1. Define what high-quality, culturally aligned behavior means for each language.
  2. Design and implement evaluations, data guidelines, and synthetic testing environments for multilingual settings.
  3. Develop robust evaluation pipelines to assess the multilingual capabilities of model candidates.
  4. Interact with models across languages to identify where behavior can be improved.
  5. Shape how models reflect the cultural context of the users and regions they serve.

Skills

Required

  • Building robust evaluation frameworks for AI systems
  • Linguistics
  • Language
  • Translation
  • Reasoning in large language models
  • Tool use in large language models
  • Defining and measuring model behavior across diverse linguistic and cultural contexts

Nice to have

  • Multilingual natural language processing

What the JD emphasized

  • Expertise in building robust evaluation frameworks for AI systems.
  • Depth in linguistics or multilingual natural language processing is strongly preferred.

Other signals

  • multilingual model behavior
  • cultural context
  • linguistic nuances
  • evaluation pipelines