Japanese AI Evaluator

Job Summary

To support an upcoming project focused on testing and evaluating AI chatbots, the contracted Japanese AI Evaluator will engage in hands-on evaluations, providing insights to enhance AI response quality, while working remotely and independently on a flexible schedule.

Key responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Conduct voice-based interactions with AI models, ensuring recorded sessions meet project specifications
• Submit deliverables, including write-ups, ratings, and recordings, as specified in the project's Statement of Work

Required qualifications

• Native or expert-level fluency in Japanese as spoken in Japan
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Access to a smartphone, computer, and reliable internet, with comfort using web-based tools
• Able to pass a language proficiency and technical literacy assessment