AI Quality Analyst

Job Summary

Owning the full quality cycle, the part-time AI Quality Analyst will review production conversations, create test files, and maintain the knowledge base for an AI-powered SMS bot and call training system in a remote setting.

Key responsibilities

• Review production conversations to identify and document bad bot responses
• Create and edit JSON test files to reproduce identified issues
• Maintain and expand the knowledge base by fixing content and running test suites to verify fixes

Required qualifications

• Native-level English fluency for writing realistic SMS conversations
• Proficiency in editing JSON and Markdown in an IDE
• Ability to execute terminal commands independently
• Extreme attention to detail in quality assurance tasks
• Capacity to quickly learn complex domains such as education and state government programs