AI Chatbot Quality Analyst

Job Summary

A company is looking for an AI Chatbot Quality Analyst to evaluate and improve AI-powered chatbots and dialogue systems.

Key Responsibilities

• Conduct structured evaluations of AI chatbot conversations across diverse topics and use cases
• Assess dialogue quality for context retention, state management, coherence, and natural flow
• Provide actionable recommendations for improving dialogue system performance

Required Qualifications

• 2+ years of experience in conversational AI evaluation, chatbot QA, or dialogue system testing
• Strong understanding of context, state, and coherence in extended conversations
• Analytical mindset to identify subtle quality issues in natural language interactions
• Familiar with conversation design principles and common chatbot failure modes
• Comfortable working independently and managing your own schedule