AI Quality Assurance Analyst

Job Summary

Detail-oriented and curious, the full-time remote AI Quality Assurance Analyst will evaluate AI-powered applications for reliability and accuracy, ensuring they are ready for real-world use across various business lines.

Key responsibilities

• Design and execute test plans for AI applications, focusing on output quality and functional behavior
• Evaluate AI responses for accuracy, consistency, and edge case handling while testing application workflows and integrations
• Document and track defects using issue tracking tools, collaborating with AI Builders and Product Managers to define quality standards

Required qualifications

• Experience in a QA or testing role, preferably with exposure to AI or LLM-based products
• Strong ability to evaluate AI-generated outputs for quality and appropriateness
• Experience writing and executing test cases and documenting defects
• Familiarity with issue tracking tools such as Jira
• Bachelor's degree or equivalent experience in a related field