Remote Jobs Sign In

Senior Software Development Engineer in Test

Location: Remote
Compensation: To Be Discussed
Reviewed: Tue, Oct 13, 2026
This job expires in: 30 days

Job Summary

Focusing on quality assurance for GenAI/Agentic systems, the full-time remote Senior Software Development Engineer in Test will develop testing strategies, evaluation frameworks, and automated test suites specifically for LLM-powered applications.

Key responsibilities
  • Design and architect comprehensive test plans and quality metrics for LLM-powered applications
  • Develop robust end-to-end automated test suites in Python, including evaluations, API checks, and performance tests
  • Establish multi-dimensional evaluation criteria to measure GenAI quality across various metrics
Required qualifications
  • Deep understanding of GenAI technologies, including LLMs and prompt engineering
  • Strong hands-on experience with Python coding and test automation frameworks
  • Proven ability to design test cases for non-deterministic systems
  • Experience with API testing tools and backend testing
  • Strong experience with CI/CD pipelines and automated testing integration

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 40,121 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee