QA Engineer

Job Summary

To ensure the quality of AI products, the contract QA Engineer will validate outputs, detect hallucinations, verify citations, and maintain test coverage while working remotely.

Key responsibilities

• Design and execute comprehensive test plans for AI products, focusing on input variants and user roles
• Run structured test passes across web UIs and APIs, investigating failures to provide actionable insights to engineers
• Maintain regression coverage and stay updated on AI evaluation tools to ensure ongoing product quality

Required qualifications

• 5+ years of manual and automation QA experience in production environments
• Hands-on experience testing AI/LLM-based products, including output validation and hallucination detection
• Strong test-planning skills for large combinatorial test matrices
• API testing fluency using tools like Postman or Insomnia, and familiarity with OpenAPI specifications
• Basic SQL knowledge for read-only queries to verify data integrity