AI Chatbot Evaluator

Job Summary

Engaging with AI chatbots on health and wellness topics, the contracted AI Chatbot Evaluator will independently follow instructions, provide detailed feedback on interactions, and assess chatbot performance using personal accounts and conversation history in a remote capacity.

Key responsibilities

• Interact with assigned AI models to evaluate personalized response quality on health and wellness topics
• Complete structured evaluation forms based on personal experiences with the chatbots
• Implement feedback and make necessary adjustments to ensure high-quality submissions

Required qualifications

• Must be 18 years of age or older
• Currently residing in the United States
• Proficient in reading and writing instructions in English
• Possess an active personal account with either Gemini, ChatGPT, or Claude Pro with at least one month of usage history
• Comfortable with an iterative workflow and adapting to changes as needed