Senior Data Scientist

Job Summary

Owning the diagnostic loop for LLM-based clinical services, the full-time Senior Data Scientist will evaluate and improve AI systems by designing experiments, testing candidate fixes, and mentoring team members, all while working remotely.

Key responsibilities

• Manage the diagnostic loop for LLM-based clinical services, forming hypotheses and designing experiments to address failure modes
• Oversee the evaluation roadmap and quality metrics for AI services, ensuring structured evaluations and confirming improvements
• Document the diagnostic playbook and mentor team members in evaluation methods as the function scales

Required qualifications

• Bachelor's degree in Data Science, Computer Science, Statistics, or a related quantitative field or equivalent experience
• 5+ years of data science or applied machine learning experience, including production-level models or AI systems
• 2+ years of hands-on experience evaluating and improving LLM-based systems with structured error analysis and experiment design
• Strong Python skills and solid data-analysis capabilities; familiarity with metrics such as sensitivity and specificity
• Demonstrated experience with LLM evaluation methods and tools, including golden/regression sets