Bengali AI Evaluator

Job Summary

Offering a remote contracted opportunity, the Bengali AI Evaluator will engage in developmental projects by testing and evaluating AI chatbots to enhance their response quality through direct user interaction.

Key responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Conduct voice-based interactions with AI models, ensuring sessions are recorded and deliverables are submitted as specified
• Provide insights and data that inform model development and optimization based on evaluations

Required qualifications

• Native or expert-level fluency in Bengali as spoken in Bangladesh
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Access to a smartphone, computer, and reliable internet, with comfort in using web-based tools
• Able to pass a language proficiency and technical literacy assessment