Senior AI Quality Engineer

Job Summary

A company is looking for a Senior AI Quality Engineer.

Key Responsibilities

• Define testing standards and patterns for AI, ensuring product teams validate AI behavior effectively
• Build and manage the LLM evaluation framework, selecting appropriate tools and methodologies for AI performance measurement
• Integrate quality gates into CI/CD pipelines to catch regressions in AI behavior before production

Required Qualifications

• 5-8 years of software engineering or quality assurance experience
• Hands-on experience building evaluation frameworks for LLM-powered features
• Strong engineering fundamentals with real coding and tooling experience
• Experience integrating automated quality checks into CI/CD pipelines
• Familiarity with LLM APIs and agent frameworks, alongside designing human review workflows