Brazilian Portuguese AI Evaluator

Job Summary

Seeking Brazilian Portuguese AI Evaluators for a remote, contracted, entry-level position focused on testing and evaluating AI chatbots to enhance response quality through direct user interaction with various AI models.

Key responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Engage in voice-based interactions with AI models, submitting recordings and audio as part of evaluation deliverables
• Provide insights and data to inform model development and optimization through structured hands-on evaluations

Required qualifications

• Native or expert-level fluency in Portuguese, as spoken in Brazil
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Ability to pass a language proficiency and technical literacy assessment
• Access to a smartphone, computer, and reliable internet connection