AI Policy Generalist

Job Summary

As an AI Policy Generalist, the full-time remote position will evaluate complex customer policies by analyzing user requests and AI model responses, ensuring accurate classifications while engaging with sensitive content and maintaining consistency across various policy domains.

Key responsibilities

• Evaluate user requests and AI model responses within relevant conversation contexts
• Distinguish between closely related labels and policy boundaries, providing evidence-based rationales
• Participate in calibration discussions and challenge interpretations respectfully to refine evaluations

Required qualifications

• Experience in quality assurance, research, editing, law, or similar fields requiring careful interpretation
• Ability to learn new customer policies and evaluation frameworks quickly
• Strong written communication skills for clear and precise explanations of judgment calls
• Intellectual curiosity and comfort in fast-changing environments
• Experience engaging with sensitive material responsibly and maintaining sound judgment