AI Evaluation Analyst

Job Summary

A company is looking for a Writer / AI Annotator.

Key Responsibilities

• Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions)
• Assess quality against project-specific criteria such as correctness, coherence, and cultural appropriateness
• Provide detailed written feedback and collaborate with Project Managers to meet accuracy and turnaround benchmarks

Required Qualifications

• Bachelor's degree/diploma or equivalent educational qualification
• 1+ years of experience in data annotation, LLM evaluation, or related AI/ML domains
• Demonstrated experience with data annotation tools and software platforms
• Strong understanding of language and multimodal communication
• Ability to adapt quickly to changing project directions and fast-paced work environments