AI QA Engineer

Job Summary

A company is looking for an AI QA Engineer II/III.

Key Responsibilities

• Lead quality validation of AI models and conversational agents through prompt testing and dialogue flow evaluations
• Analyze user interactions to identify issues and generate insights for model improvement
• Document testing results and publish evaluations to ensure conversational interactions meet quality standards

Required Qualifications

• 2-4 years of experience in QA and conversational AI for level II; 4-7 years for level III
• Preferred experience in NLP, LLM prompt engineering, or automated testing frameworks
• Bachelor's degree in computer science, Data Science, Linguistics, Cognitive Science, HCI, or a related field
• Solid understanding of LLM behavior and experience testing APIs and conversational UX
• Strong analytical skills for pattern recognition in model outputs