AI Annotation Specialist

Job Summary

Detail-oriented and curious, the entry-mid level AI Evaluation & Annotation Specialist will work remotely on a contract basis to review AI-generated responses, provide corrections, and evaluate quality while following structured guidelines to ensure accuracy and consistency.

Key responsibilities

• Review AI-generated responses and rate them for clarity, correctness, and relevance
• Annotate and label content based on project-specific guidelines
• Generate or evaluate prompts depending on assignment type and work with QA Leads to improve task quality

Required qualifications

• Fluency in Japanese, with strong written and verbal communication skills
• Bachelor's degree in Linguistics, Computer Science, or a related field; or equivalent experience
• Experience or interest in AI, Machine Learning, or data annotation preferred
• Strong attention to detail and ability to work with complex data sets
• Familiarity with translation and localization processes is an advantage