QA Engineer

Job Summary

To validate AI products and ensure quality across various changes, the contract QA Engineer will work remotely, designing test plans, verifying outputs, and maintaining regression coverage while collaborating closely with engineering teams.

Key responsibilities

• Build and maintain test plans for AI products, focusing on detecting hallucinations and verifying evidence citations
• Run structured test passes across web UIs and APIs, investigating failures and filing clear defects for engineers
• Maintain regression coverage as products evolve, partnering with engineers to verify acceptance criteria for AI behavior in production

Required qualifications

• 5+ years of manual and automation QA experience in product environments
• Hands-on experience testing AI/LLM-based products, including output validation and hallucination detection
• Strong test-planning skills for large combinatorial test matrices
• Proficiency in API testing tools such as Postman or Insomnia and familiarity with OpenAPI/Swagger specs
• Basic SQL knowledge for read-only queries to verify data states in PostgreSQL or equivalent