AI Evaluator for Shopping Assistant
Location: Remote
Compensation: To Be Discussed
Reviewed: Tue, Sep 01, 2026
This job expires in: 29 days
Job Summary
To improve a digital shopping assistant's performance, the contract AI Evaluator for Shopping Assistant will analyze user interactions, identify inaccuracies, and develop structured evaluation frameworks while working remotely for 20+ hours per week.
Key responsibilities
- Review real user interaction traces with the AI shopping assistant
- Identify logical failures, inaccuracies, or poor recommendations in the text
- Create structured rubrics and verifiers to judge response quality
Required qualifications
- Experience in data evaluation, quality assurance, or AI training
- Strong analytical skills with the ability to spot subtle errors in text
- Familiarity with e-commerce search and digital shopping experiences
- Ability to commit to a sustained workload of 20+ hours per week
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 44,891 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee