Italian AI Evaluator

Job Summary

Offering a remote, contracted opportunity, the Italian AI Evaluator will assess and enhance the capabilities of AI chatbots through structured evaluations and user interactions, contributing to the development of generative AI models.

Key responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Engage in voice-based interactions with AI models, recording sessions as part of the evaluation deliverables
• Submit detailed deliverables, including write-ups, ratings, screenshots, or recordings, as specified for each task

Required qualifications

• Native or expert-level fluency in Italian, as spoken in Italy
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Access to a smartphone, computer, and reliable internet
• Able to pass a language proficiency and technical literacy assessment