Senior AI Data Analyst

Job Summary

Working remotely on a temporary basis during a maternity leave, the Senior AI Data Operations Analyst will ensure high-quality, relevant experiences for recommendation engines and AI-powered features by executing data annotation, defining quality standards, and running qualitative evaluations.

Key responsibilities

• Execute and lead data annotation efforts to create high-quality training datasets for recommendation models
• Establish quality criteria and metrics for core features and the evaluation of LLM judges
• Design and conduct structured qualitative evaluations, incorporating human judgment and AI tools

Required qualifications

• Proven experience in data annotation, data quality, or product/content quality analysis
• Strong qualitative and analytical skills with the ability to handle large datasets and translate feedback into quality metrics
• Familiarity with machine learning product development and its evaluation processes
• Demonstrated ability to create or refine evaluation frameworks and guidelines
• Excellent written and verbal communication skills for presenting findings and guiding teams