Colorado Licensed Physician

Job Summary

To support a medical AI evaluation project, a part-time Freelance AI Trainer will utilize their Colorado Licensed Physician (MD/DO) credentials to review and assess clinical EHR vignettes remotely, focusing on diagnosis and treatment tasks without patient contact.

Key responsibilities

• Evaluate clinical EHR vignettes against acceptance criteria, including diagnosis and treatment tasks across multiple medical systems
• Score the quality of clinical reasoning in benchmark items, assessing accuracy, completeness, and reasoning chains
• Provide short rationales for evaluations and participate in independent blind reads followed by physician adjudication

Required qualifications

• Medical degree (MD or DO) and an active, unrestricted US medical license
• Board certification or completed residency training with direct patient care experience
• Broad diagnostic and treatment experience in internal, family, emergency, or hospital medicine
• Strong clinical reasoning skills, including differential diagnosis and application of evidence-based guidelines
• Prior experience in medical AI evaluation or clinical content review is a plus