Jobs

Mistral AI is seeking its first Evaluation Engineer to join the Applied AI team, a customer-facing technical organization. This role involves designing and implementing comprehensive evaluation frameworks and infrastructure to measure LLM capabilities across diverse customer use cases. You will define what "ready for production" means for AI solutions, focusing on domain-specific, risk-aware, and production-grade evaluations. The ideal candidate will have 3+ years of experience in ML evaluation for LLMs, strong Python coding skills, and a deep understanding of machine learning concepts. This critical cross-functional role sits at the intersection of research, engineering, and solutions, aiming to improve model capabilities for enterprise customers.