
Job Description
About the role
As a Model Behaviour Architect in the Multilingual team, you define and measure what good model behaviour looks like across languages, not just in English.
We are looking for people who have built a career in engineering, machine learning, and large language models and are experts in model evaluation, policy writing, and building eval pipelines for complex tasks. Your role is to work hand in hand with our Science team to define what “good” means for multilingual behaviour: language adherence, naturalness, cultural alignment, and consistent capability across the languages in which our models are deployed.
Join us if you are passionate about tackling cutting-edge, open-ended research challenges and transforming your insights into best-in-class models that work for users in every language and culture they belong to.
What you will do
-
Interact with models across languages to identify where multilingual behaviour can be improved
-
Gather internal and external feedback to scope areas for improvement
-
Define what high-quality behavior means per language
-
Design and implement evals, data guidelines, data generation, and synthetic testing environments for multilingual settings
-
Shape how models reflect the cultural context of the users and regions they serve
-
Identify and fix edge-case behaviors through rigorous cross-language testing
-
Develop robust evaluation pipelines for model candidates
-
Work collaboratively with AI Scientists
About you
-
You are an expert at building robust evaluations
-
You have a strong understanding of at least one of: linguistics, language, and translation; LLM agents at work, including reasoning and tool use. Depth in linguistics or multilingual NLP is strongly preferred
-
You thrive in dynamic and technically complex environments
-
You have a track record of delivering innovative, out-of-the-box solutions to address real-world constraints
What We Offer
Optimize Your Resume for This Job
Get a match score and see exactly which keywords you're missing
Job Details
- Category
- Research
- Employment Type
- Full Time
- Location
- Paris, France (Hybrid)
- Posted
About Mistral AI
Frontier AI in your hands. Mistral AI believes in a future where AI is abundant and accessible, empowering the world to build with and benefit from the most significant technology of our time.
More Roles at Mistral AI





Similar Research Roles



Found this role interesting?