Remote Jobs Sign In

Licensed Physician AI Evaluator

Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.

Location: Remote
Compensation: Hourly
Reviewed: Sat, Nov 07, 2026
This job expires in: 30 days

Job Summary

To support a medical AI evaluation project, a part-time Licensed Physician AI Evaluator will review clinical EHR vignettes, scoring clinical reasoning quality and providing insights remotely, with flexible hours estimated at 10-20 hours per week.

Key responsibilities
  • Evaluate clinical EHR vignettes and assess the accuracy and completeness of proposed answers
  • Score the quality of clinical reasoning and provide rationales based on vignette facts
  • Participate in independent blind reads and adjudication processes to ensure clinical complexity is accurately represented
Required qualifications
  • Medical degree (MD or DO) and an active, unrestricted US medical license
  • Board certification or completed residency training with recent direct patient care experience
  • Broad diagnostic and treatment experience across multiple medical systems
  • Strong clinical reasoning skills, including differential diagnosis and application of evidence-based guidelines
  • Prior experience in medical AI evaluation or clinical content review is a plus

Complete Job Description

The complete job description is available to premium members. Premium membership includes:

Full access to 39,516 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee