AI Evaluation Analyst

Job Summary

A company is looking for a Writer / AI Annotator (Remote - freelance, 100+ openings).

Key Responsibilities

• Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts)
• Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety
• Identify subtle errors, hallucinations, or biases in AI responses

Required Qualifications

• Bachelor's degree/diploma or equivalent educational qualification
• 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains
• Demonstrated experience working with data annotation tools and software platforms
• Strong understanding of language and multimodal communication
• Ability to adapt quickly to changing project directions and fast-paced work environments