AI Test Engineer

Job Summary

To ensure the quality and reliability of AI-powered systems, the full-time remote AI Test Engineer II will validate AI outputs, design test strategies for models, and collaborate with cross-functional teams to enhance testing standards and practices.

Key responsibilities

• Design and execute test strategies for AI/ML models, including functional and regression testing
• Validate interactions between AI agents, APIs, and downstream systems while identifying failure points in workflows
• Build and maintain automated test frameworks and integrate testing into CI/CD pipelines

Required qualifications

• Bachelor's degree in Computer Science, Data Science, Engineering, or a related field (or equivalent experience)
• Experience in QA, testing, or a related engineering role
• Strong understanding of software testing principles and test automation
• Familiarity with AI/ML concepts and experience testing APIs or data pipelines
• Experience working in an Agile development environment