Korean AI Evaluator

Job Summary

To enhance the quality of AI chatbots, the contracted Korean AI Evaluator will participate in remote evaluations of AI models through structured interactions, providing insights that inform model development and optimization.

Key responsibilities

• Test and evaluate AI chatbots and language models through structured conversations using assigned goals and prompts
• Engage in voice-based interactions with AI models, providing recorded sessions and audio as part of deliverables
• Submit evaluations and deliverables, including write-ups, ratings, and screenshots, according to project specifications

Required qualifications

• Native or expert-level fluency in Korean as spoken in South Korea
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Access to a smartphone, computer, and reliable internet with comfort in using web-based tools
• Able to pass a language proficiency assessment and AI evaluation task