Japanese Quality Analyst

Job Summary

To support the evaluation of personalized AI interactions, the full-time Japanese Quality Analyst will assess a new feature for Gemini by designing prompts based on personal experiences and analyzing the quality of model responses, all while working remotely from either the USA or Japan.

Key responsibilities

• Design and execute multi-turn conversational prompts to evaluate AI responses
• Assess model responses for personalization quality, including Grounding and Integration issues
• Write clear rationales for comparisons of model responses and maintain data hygiene

Required qualifications

• Proficiency in reading and writing Japanese at a high level
• BS/BA degree or equivalent experience in a relevant field such as Linguistics or Computer Science
• Experience in data annotation, AI quality evaluation, or content moderation is preferred
• Exceptional analytical thinking with the ability to evaluate nuanced AI responses
• Schedule flexibility to commit at least 30 hours per week with overlap in PST time zone