Machine Learning Evaluation Expert

Job Summary

Seeking subject matter experts for a remote contract opportunity, the Machine Learning Evaluation Expert will evaluate AI-generated model outputs for accuracy and relevance, providing written justifications for their assessments over approximately five hours of independent work.

Key responsibilities

• Review machine learning model outputs across various research tasks
• Rate AI-generated responses for accuracy, relevance, and factual correctness
• Provide clear written justifications for evaluation scores

Required qualifications

• Professional or academic expertise in a specialized domain
• Strong critical thinking and analytical skills
• Experience evaluating technical content or research data
• Comfortable reading and assessing complex technical or research-focused text
• Ability to commit approximately five hours to complete the evaluation tasks