California Licensed Annotation Judge

Job Summary

To enhance AI/ML processes in real estate, the temporary, fully remote California Licensed Annotation Judge will review annotated data, provide feedback to engineers, and collaborate with teams to optimize model performance while ensuring quality standards are met.

Key responsibilities

• Review and evaluate annotated data to ensure quality standards and project requirements are met
• Provide feedback and guidance to engineers to improve accuracy and optimize model performance
• Develop and maintain annotation guidelines and best practices for training data

Required qualifications

• Minimum of 3+ years of active experience as a licensed real estate agent or broker
• Demonstrated interest in Artificial Intelligence, with experience reviewing AI-generated content
• Bachelor's degree in English, Linguistics, or a related field
• Experience with Natural Language Processing projects focused on transcriptions and localization
• Familiarity with tools and software used for Natural Language Processing annotation is a plus