Government SME for AI Evaluation

Job Summary

To support the evaluation of AI systems in the public sector, the part-time Government Subject Matter Expert (SME) for AI Evaluation will assess AI-generated responses for accuracy and compliance with regulations while working remotely as an independent contractor.

Key responsibilities

• Evaluate AI-generated responses for accuracy, completeness, and regulatory alignment
• Identify errors and gaps in AI interpretations and provide actionable feedback
• Develop evaluation benchmarks and collaborate on quality reviews to ensure consistency

Required qualifications

• At least 2 years of relevant professional experience in government operations or regulatory compliance
• Demonstrated subject matter expertise in government policy, compliance, or procurement
• Experience interpreting and evaluating government policies and regulations
• Strong analytical reasoning skills to identify inaccuracies and unsupported conclusions
• Ability to conduct independent research and validate information using authoritative sources