Product Content Engineer

Job Summary

Partnering with Meta's agent tooling team, the full-time Product Content Engineer will define model quality standards and evaluate AI performance to enhance internal productivity tools, working remotely to build frameworks and assess model behavior.

Key responsibilities

• Define quality standards for AI model performance and systematically evaluate outputs for Meta's internal AI assistant
• Design evaluation frameworks, taxonomies, and guidelines to integrate qualitative and quantitative signals
• Work cross-functionally with engineering and product teams to align AI behaviors with user expectations and document evaluation results

Required qualifications

• Bachelor's degree in Computer Science, Data Science, Linguistics, or a related field, or equivalent practical experience
• 5+ years of experience collaborating with product, engineering, design, and user research teams
• 2+ years of experience with generative AI products, AI evaluation, and prompt engineering
• Experience designing evaluation frameworks and quality rubrics for agentic systems
• Demonstrated data analysis skills with the ability to produce actionable insights and communicate findings effectively