QA Automation Engineer
Job Summary
To validate AI products and ensure quality across various changes, the contract QA Automation Engineer will design test plans, maintain test suites, and verify outputs while working remotely.
Key responsibilities
- Build and maintain test plans for AI products, focusing on input variants and content states
- Run structured test passes and validate evidence citations, ensuring compliance with access controls
- Maintain regression coverage and partner with engineers to verify acceptance criteria for AI behavior
Required qualifications
- 5+ years of manual and automation QA experience in production-grade environments
- Hands-on experience testing AI/LLM-based products, including output validation and hallucination detection
- Strong test-planning skills for large combinatorial test matrices
- Fluency in API testing using tools like Postman or Insomnia and reading OpenAPI specs
- Basic SQL knowledge for read-only queries to verify data states
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 46,304 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
