Portuguese Quality Analyst

Job Summary

Evaluating AI interactions, the full-time Portuguese Quality Analyst will assess the personalization quality of model responses by designing prompts based on personal experiences and analyzing the effectiveness of the AI's utilization of user data, all while working remotely.

Key responsibilities

• Design and execute multi-turn conversational prompts to test AI personalization
• Evaluate model responses for accuracy, grounding, and integration of personal data
• Write clear rationales for comparisons of model responses, highlighting strengths and weaknesses

Required qualifications

• Proficiency in Portuguese with strong reading and writing skills
• BS/BA degree or equivalent experience in a relevant field
• Experience in data annotation, AI quality evaluation, or content moderation preferred
• Exceptional analytical thinking and creative prompt engineering skills
• Ability to work independently in a remote setting with a flexible schedule