Japanese AI Quality Analyst

Job Summary

A company is looking for a Japanese LLM Quality Analyst, who will evaluate the quality of personalized AI interactions.

Key Responsibilities

• Design and execute multi-turn conversational prompts to test AI personalization
• Evaluate model responses for personalization quality, including Grounding and Integration
• Write clear rationales for model comparisons and maintain data hygiene

Required Qualifications

• Proficiency in reading and writing Japanese
• Full-time availability with schedule flexibility for a global operations team
• Experience in creative prompt engineering and AI quality evaluation
• BS/BA degree or equivalent experience in a relevant field
• Preferred experience in data annotation, content moderation, or related roles