QA Automation Engineer
Job Summary
Focused on quality assurance for GenAI systems, the remote QA Automation Engineer will develop testing strategies, implement evaluation frameworks, and ensure the reliability of LLM-powered applications through automated testing using Python.
Key responsibilities
- Develop and execute end-to-end automated test coverage across evaluations, APIs, UIs, and performance tests
- Implement testing strategies for GenAI features, including conversational AI and LLM-powered workflows
- Support and maintain evaluation frameworks to measure GenAI performance across various metrics
Required qualifications
- Solid QA or test engineering experience, with exposure to AI/ML systems
- Hands-on Python coding experience
- Good understanding of GenAI technologies, including LLMs and prompt engineering
- Experience with test automation frameworks and scripting (Python, Pytest, API, and UI Testing)
- Familiarity with CI/CD pipelines and automated testing integration
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,121 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
Wikipedia Wikipedia URL
BBB URL BBB URL
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
