Senior Software Development Engineer in Test
Location: Remote
Compensation: To Be Discussed
Reviewed: Tue, Oct 13, 2026
This job expires in: 30 days
Job Summary
Focusing on quality assurance for GenAI/Agentic systems, the full-time remote Senior Software Development Engineer in Test will develop testing strategies, evaluation frameworks, and automated test suites specifically for LLM-powered applications.
Key responsibilities
- Design and architect comprehensive test plans and quality metrics for LLM-powered applications
- Develop robust end-to-end automated test suites in Python, including evaluations, API checks, and performance tests
- Establish multi-dimensional evaluation criteria to measure GenAI quality across various metrics
Required qualifications
- Deep understanding of GenAI technologies, including LLMs and prompt engineering
- Strong hands-on experience with Python coding and test automation frameworks
- Proven ability to design test cases for non-deterministic systems
- Experience with API testing tools and backend testing
- Strong experience with CI/CD pipelines and automated testing integration
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,121 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee