Medical AI Evaluator

Job Summary

Evaluating AI-generated medical content, the remote hourly Medical AI Evaluator will assess clinical accuracy, develop test cases, and provide feedback to enhance the reliability and safety of healthcare information.

Key responsibilities

• Evaluate AI-generated medical responses for clinical accuracy and reasoning quality
• Identify errors in clinical methodology and provide clear feedback on corrections
• Develop prompts and test cases to assess AI accuracy across various clinical scenarios

Required qualifications

• Bachelor's degree or higher in Medicine (MD/DO), Nursing, Public Health, Health Sciences, or Allied Health
• 5+ years of professional experience in a relevant healthcare discipline
• Strong clinical reasoning skills, including differential diagnosis and risk stratification
• Solid understanding of disease processes, patient care, and medical terminology
• Full professional English proficiency with exceptional writing skills