AI Product Analyst

Job Summary

As a full-time remote Staff AI Product Analyst, the successful candidate will define AI-native product analytics, prioritize use cases, and establish evaluation frameworks to ensure alignment between human teams and AI agents.

Key responsibilities

• Partner with AI product and engineering teams to define metrics for flagship AI journeys, focusing on adoption and business outcomes
• Design and maintain evaluation frameworks and monitor agent outputs for accuracy and usefulness
• Collaborate with business leaders to translate AI capabilities into measurable business outcomes and deliver measurement artifacts for prioritization

Required qualifications

• 10+ years of experience in product analytics, data science, or technical product management in a high-scale environment
• 1+ years of hands-on experience with AI/LLM systems, focusing on evaluation and deployment
• Deep technical proficiency with Python, ML frameworks, and data visualization platforms
• Proven track record in designing AI evaluation frameworks and production monitoring
• Exceptional ability to communicate technical insights to non-technical stakeholders