Senior Data Scientist
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Job Summary
Owning the diagnostic loop for LLM-based clinical services, the full-time Senior Data Scientist will evaluate and improve AI systems by designing experiments, testing candidate fixes, and developing evaluation criteria while working remotely.
Key responsibilities
- Manage the diagnostic loop for LLM-based clinical services, identifying failure modes and designing experiments to isolate causes
- Develop and oversee the evaluation roadmap for AI services, defining metrics and ensuring quality standards are met before deployment
- Collaborate with clinical reviewers and product managers to convert findings into actionable evaluation criteria and mentor team members in evaluation methods
Required qualifications
- Bachelor's degree in Data Science, Computer Science, Statistics, or a related quantitative field or equivalent experience
- 5+ years of data science or applied machine learning experience, with a focus on production models or AI systems
- 2+ years of hands-on experience in evaluating and improving LLM-based systems, including structured error analysis and experiment design
- Strong proficiency in Python and data analysis, with familiarity in metrics such as sensitivity and specificity
- Demonstrated hypothesis-driven working style, with strong written communication skills for conveying findings to diverse audiences
Complete Job Description
The complete job description is available to premium members. Premium membership includes:
Full access to 38,064 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee