AI Quality Analyst
Location: Remote
Compensation: Piece Work
Reviewed: Wed, Sep 09, 2026
This job expires in: 30 days
Job Summary
To enhance personalized AI experiences, the full-time English AI Quality Analyst will design and evaluate multi-turn prompts, assess AI responses for relevance and helpfulness, and provide evidence-based rationales, all while working remotely.
Key responsibilities
- Design and execute short, multi-turn prompts requiring meaningful personalization
- Compare AI responses and evaluate their grounding, integration, and helpfulness
- Write clear rationales that reference specific conversational turns and review debug information
Required qualifications
- Bachelor's degree or equivalent practical experience in an analytical field
- Strong English reading and writing ability
- Willingness to use a personal Google account
- Ability to work independently on a remote team with a reliable computer and internet connection
- Excellent analytical judgment and attention to detail
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,966 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee