Data Scientist for AI Evaluation

Job Summary

A company is looking for a Data Scientist - AI Evaluation.

Key Responsibilities

• Define and evolve accuracy metrics across the full shopping experience
• Design and run experiments to measure improvements and regressions
• Create dashboards and reporting that make agent performance visible and actionable

Required Qualifications

• 4-6+ years in Data Science, ML Evaluation, or Applied AI
• Deep experience evaluating AI/ML systems, including ranking and recommendations
• Strong experience with experimentation methods such as A/B testing
• Experience with consumer products or user-facing systems, preferably in e-commerce
• Ability to translate complex problems into structured analysis and metrics