Remote Jobs Sign In

Japanese AI Evaluator

Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.

Location: Remote
Compensation: Piece Work
Reviewed: Thu, Nov 05, 2026
This job expires in: 27 days

Job Summary

To support the evaluation of AI chatbots, the contracted Japanese AI Evaluator will engage in hands-on testing and assessment of AI models remotely, providing insights to enhance their performance and safety.

Key responsibilities
  • Test and evaluate AI chatbots through structured conversations, using assigned goals and prompts
  • Conduct voice-based interactions with AI models and submit deliverables as specified in project guidelines
  • Provide feedback and insights based on direct user interaction with various AI models
Required qualifications
  • Native or expert-level fluency in Japanese
  • Strong English reading, writing, and communication skills
  • Hands-on experience using AI models or large language models
  • Access to a smartphone, computer, and reliable internet
  • Able to pass a language proficiency and technical literacy assessment

Complete Job Description

The complete job description is available to premium members. Premium membership includes:

Full access to 37,718 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee