Colorado Licensed Physician Evaluator

Job Summary

To support a medical AI evaluation program, the part-time Colorado Licensed Physician Evaluator will evaluate clinical EHR vignettes, score clinical reasoning quality, and provide rationales for proposed answers, all while working remotely on a project-based basis.

Key responsibilities

• Evaluate clinical EHR vignettes and assess diagnosis and treatment tasks across multiple medical systems
• Score the quality of clinical reasoning and ensure accuracy and completeness of vignettes and answers
• Participate in independent blind reads and physician adjudication to enhance AI tools for clinical use

Required qualifications

• Medical degree (MD or DO) with an active, unrestricted US medical license
• Board certification or completed residency training with recent direct patient care experience
• Broad diagnostic and treatment experience in internal, family, emergency, or hospital medicine
• Strong clinical reasoning skills and familiarity with evidence-based guidelines
• Prior experience in medical AI evaluation or clinical content review is a plus