Chatbot Quality Analyst

Job Summary

A company is looking for a Chatbot Quality Analyst to evaluate and improve AI-powered chatbots and dialogue systems.

Key Responsibilities

• Conduct structured evaluations of AI chatbot conversations across diverse topics and use cases
• Assess dialogue quality for context retention, state management, coherence, and natural flow
• Document failure patterns, edge cases, and quality issues using structured feedback frameworks

Required Qualifications

• 2+ years of experience in conversational AI evaluation, chatbot QA, or dialogue system testing
• Strong understanding of context, state, and coherence in extended conversations
• Analytical mindset with the ability to identify subtle quality issues in natural language interactions
• Familiarity with conversation design principles and common chatbot failure modes