AI Model Evaluation Director

Job Summary

A company is looking for a Director of AI Model Evaluation & Quality Validation - LLMs & Generative AI.

Key Responsibilities

• Evaluate the performance of AI models utilizing Large Language Models (LLMs)
• Develop and implement metrics to assess model accuracy, efficiency, and effectiveness
• Provide detailed reports and recommendations for model improvements

Required Qualifications

• Master's or Ph.D. in Computer Science, Machine Learning, Artificial Intelligence, or a related field
• 7+ years of experience in machine learning, focusing on natural language processing and LLMs
• Proven track record of evaluating and improving AI models involving LLMs
• Strong programming skills in Python with experience in machine learning frameworks
• Familiarity with performance evaluation metrics and techniques for LLMs