Swahili AI Evaluator

Job Summary

To enhance the quality of AI chatbot responses, the remote contracted Swahili AI Evaluator will engage in hands-on evaluations of various AI models through structured interactions, providing insights that inform model development.

Key responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Conduct voice-based interactions with AI models, ensuring sessions are recorded for evaluation purposes
• Submit deliverables such as write-ups, ratings, screenshots, or recordings as specified for each task

Required qualifications

• Native or expert-level fluency in Swahili, as spoken in Kenya
• Strong English reading, writing, and communication skills
• 18 years of age or older
• Hands-on experience using AI models or large language models
• Access to a smartphone, computer, and reliable internet, with comfort in using web-based tools