AI Software Engineer in Test
Location: Remote
Compensation: Hourly
Reviewed: Tue, Sep 29, 2026
This job expires in: 30 days
Job Summary
Leading quality engineering for production conversational AI and intelligent search experiences, the full-time FLEX AI Software Engineer in Test will develop automated test strategies, maintain test suites, and validate AI application performance in a hybrid work environment.
Key responsibilities
- Defines and owns the automated quality strategy for conversational AI applications and intelligent search experiences
- Builds and maintains automated test suites, including browser, API, integration, and regression tests
- Develops automated evaluations for response correctness, relevance, and AI application performance metrics
Required qualifications
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent professional experience
- 2+ years of experience in quality engineering, test automation, or SDET roles
- Strong programming experience in Python, JavaScript, TypeScript, Java, or a comparable language
- Experience testing conversational AI, generative AI, or intelligent search applications
- Hands-on experience with automated test frameworks, performance testing, and CI/CD quality gates
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 39,986 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee