New York Licensed Physician

Job Summary

To support a medical AI evaluation program, a part-time Freelance AI Trainer will evaluate clinical EHR vignettes, scoring clinical reasoning quality and ensuring accuracy in diagnosis and treatment tasks, working remotely.

Key responsibilities

• Evaluate clinical EHR vignettes and assess accuracy, completeness, and reasoning quality across various medical systems
• Score benchmark items based on correctness, gradeability, and trap quality while providing rationales for decisions
• Collaborate through independent blind reads and physician adjudication to enhance AI tools for clinical use

Required qualifications

• Medical degree (MD or DO) with an active, unrestricted US medical license
• Board certification or completed residency training with recent direct patient care experience
• Broad diagnostic and treatment experience in internal, family, emergency, or hospital medicine
• Strong clinical reasoning skills and familiarity with evidence-based guidelines
• Prior experience in medical AI evaluation or clinical content review is a plus