AI Quality and Governance Manager

Job Summary

Leading the AI Quality and Governance function, the full-time remote AI Quality and Governance Manager will own the platform for AI evaluations, observability, and governance, while actively engaging in hands-on coding and team development.

Key responsibilities

• Own the AI evaluations and observability platform, including tracing, logs, dashboards, and quality signals
• Design and operationalize automated evaluation strategies, integrating quality and safety checks into engineering processes
• Establish standards for production-ready AI, including evaluation criteria and incident playbooks

Required qualifications

• 8+ years of software engineering experience with a focus on leading engineering teams
• Strong experience in designing and operating production backend systems and APIs
• Hands-on experience with production AI systems, preferably including LLM-powered workflows
• Familiarity with AI governance frameworks such as NIST AI RMF or ISO/IEC 42001
• Practical experience in implementing AI guardrails and controls for model behavior