California Licensed Real Estate Judge

Job Summary

To support a tech real estate company, the fully remote Agentic Judge (California Licensed Real Estate Judge) will review and evaluate annotated data, ensure quality standards, and collaborate with engineers and data scientists to optimize AI/ML processes related to real estate interactions.

Key responsibilities

• Review and evaluate annotated data to ensure it meets quality standards and project requirements
• Provide feedback and guidance to engineers to improve accuracy and model performance
• Develop and maintain annotation guidelines and best practices for project consistency

Required qualifications

• Minimum of 3+ years of active experience as a licensed real estate agent or broker
• Demonstrated interest in Artificial Intelligence, including experience with AI-generated content
• Bachelor's degree in English, Linguistics, or a related field
• Experience with Natural Language Processing projects focused on transcriptions and localization
• Excellent attention to detail and analytical skills