AI/ML Engineer

Location: Remote
Compensation: Salary
Reviewed: Wed, May 21, 2025
This job expires in: 3 days
LLMs Evaluation Infrastructure QA Pipelines Offline Scoring

Job Summary

A company is looking for an AI/ML Engineer to take ownership of evaluation and quality across AI systems.

Key Responsibilities
  • Design and build end-to-end evaluation infrastructure for AI systems
  • Define and implement application-specific quality metrics beyond accuracy
  • Collaborate with product and clinical leads to translate subjective requirements into structured evaluation criteria
Required Qualifications
  • Experience building or owning evaluation infrastructure for LLMs or generative AI products
  • Proficiency in designing QA workflows and human-in-the-loop systems
  • Ability to create testable quality metrics from product goals
  • Strong coding skills and experience shipping experiments
  • Familiarity with working in cross-functional teams to define quality in real-world AI applications
GET ACCESS
Access New Remote Job Listings Now

Create a free account to begin your remote job search with our expert-vetted listings, resume tips, and career tools.

COMPLETE JOB DESCRIPTION

The job description is available to subscribers. Subscribe today to get the full benefits of a premium membership with Virtual Vocations. We offer the largest remote database online...