Voice Evaluation Specialist
Job Summary
Detail-oriented and analytical, the full-time AI Voice Evaluation Specialist will evaluate the performance of AI models through real-time voice-based conversations, comparing their responses and providing structured evaluations over a 3-month remote contract.
Key responsibilities
- Review assigned scenarios and roleplay natural conversations with two different AI models, maintaining consistency in approach
- Evaluate each model across five defined dimensions and identify relevant error clusters during interactions
- Write detailed rationales for model preferences, referencing specific observations and ensuring adherence to evaluation guidelines
Required qualifications
- Bachelor's degree
- Strong attention to detail with the ability to notice subtle differences in conversational quality
- Excellent listening and comprehension skills
- Strong written communication skills for clear and objective observation explanations
- Familiarity with AI assistants, voice-based AI, or conversational systems
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,222 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
Wikipedia Wikipedia URL
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
