AI Tester

Job Summary

To ensure the quality and performance of Generative AI systems, the full-time AI Tester will develop and execute testing strategies focused on validating accuracy, fairness, and security while working remotely.

Key responsibilities

• Design and execute test strategies for GenAI systems, including LLMs and AI agents
• Validate the accuracy, relevance, consistency, and factuality of AI-generated outputs
• Assess AI systems for compliance with ethical standards and Responsible AI principles

Required qualifications

• 8+ years of experience in QA, testing, or quality engineering, with a focus on AI/ML or Generative AI systems
• Strong understanding of AI evaluation techniques, including hallucination detection and bias assessment
• Proficient in API testing (REST, JSON) and familiar with test automation tools, preferably using Python
• Experience with cloud-based AI platforms such as Azure OpenAI or AWS Bedrock
• Knowledge of software testing methodologies, including exploratory and adversarial testing