AI Quality Evaluation Lead

Job Summary

A company is looking for an AI Quality & Evaluation Lead.

Key Responsibilities

• Define technical quality acceptance criteria and fit-for-use requirements during the design phase with AI Engineers and Data Scientists
• Design and maintain an evaluation framework to assess AI systems against quality standards
• Identify and document technical AI governance controls for automated compliance with performance obligations

Required Qualifications

• 5-8+ years of experience in Data Science, ML Engineering, or AI Quality
• Practical experience in designing RAG, LLM-based Agents, or traditional ML pipelines
• Expert-level proficiency in Python (Pandas, Scikit-learn) and evaluation frameworks
• Ability to translate governance concepts into mathematical metrics and enforceable controls
• Bachelor's degree in a technical field or equivalent professional experience