AI Operations Specialist

Job Summary

Working remotely in a full-time capacity, the AI Operations Specialist will maintain the accuracy and effectiveness of Fetch's AI systems by evaluating model outputs, annotating data, and applying critical reasoning to enhance automation and AI performance.

Key responsibilities:

• Evaluate model outputs to assess accuracy, consistency, and reliability of LLM or automation performance
• Create and maintain high-quality datasets for training and improving AI models through data annotation and labeling
• Utilize critical thinking and research to resolve ambiguous data classifications and support mapping creation for ML models

Required qualifications:

• Hands-on experience with LLMs like ChatGPT and Gemini
• Proficiency in Google Sheets and Excel, including advanced features such as pivot tables and v-lookups
• Ability to research and leverage SOPs to solve ambiguous problems effectively