Machine Learning Evaluation Specialist

Job Summary

A company is looking for a Machine Learning Evaluation Specialist to design complex evaluation problems for AI systems.

Key Responsibilities

• Propose complex, original machine learning problems based on domain expertise
• Design evaluation tasks requiring advanced domain knowledge beyond standard ML pipelines
• Assess AI-generated ML solutions for correctness, creativity, and methodological rigor

Required Qualifications

• Graduate-level expertise (MS or PhD preferred) in a scientific or technical domain intersecting with machine learning
• Strong working knowledge of ML methods including model selection and evaluation metrics
• Deep familiarity with active research problems in the relevant field
• Experience publishing or conducting original research is highly valued
• Self-motivated and comfortable working independently on intellectually demanding tasks