Remote Jobs Sign In

AI Software Engineer in Test

Location: Remote
Compensation: Hourly
Reviewed: Tue, Sep 29, 2026
This job expires in: 30 days

Job Summary

Leading quality engineering for production conversational AI and intelligent search experiences, the full-time FLEX AI Software Engineer in Test will develop automated test strategies, maintain test suites, and validate AI application performance in a hybrid work environment.

Key responsibilities
  • Defines and owns the automated quality strategy for conversational AI applications and intelligent search experiences
  • Builds and maintains automated test suites, including browser, API, integration, and regression tests
  • Develops automated evaluations for response correctness, relevance, and AI application performance metrics
Required qualifications
  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent professional experience
  • 2+ years of experience in quality engineering, test automation, or SDET roles
  • Strong programming experience in Python, JavaScript, TypeScript, Java, or a comparable language
  • Experience testing conversational AI, generative AI, or intelligent search applications
  • Hands-on experience with automated test frameworks, performance testing, and CI/CD quality gates

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 39,986 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee