Remote Jobs Sign In

Staff AI Engineer

Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.

Location: Remote
Compensation: Salary
Reviewed: Thu, Nov 19, 2026
This job expires in: 30 days

Job Summary

Seeking a full-time remote Staff AI Engineer focused on Quality Assurance, the successful candidate will manage the evaluation and testing of AI systems to ensure their quality, reliability, and safety in healthcare applications.

Key responsibilities:
  • Build and own the architecture of core AI systems, including evaluation infrastructure and dataset management
  • Design error metrics and production monitoring systems to prioritize and address clinical and financial impacts
  • Collaborate with product and clinical leads to define accuracy thresholds and criteria for AI capabilities
Required qualifications:
  • 7+ years in software or machine learning engineering, with 3+ years in AI system evaluation and quality assurance
  • Proven experience in designing and building complete systems from prototype to production
  • 2+ years evaluating large language model (LLM) systems in a production environment
  • Strong statistical skills for measuring accuracy, including sampling and error analysis
  • Deep knowledge of explainable AI techniques and AI-powered tools

Complete Job Description

The complete job description is available to premium members. Premium membership includes:

Full access to 38,909 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee