Product Manager for AI Evaluation
Job Summary
Owning the product strategy and roadmap for the evaluation platform, the full-time remote Product Manager for AI Evaluation will enable teams at Relativity to understand, measure, and improve AI performance through a standardized evaluation system while collaborating closely with applied scientists and legal experts.
Key responsibilities
- Own the product vision and strategy for the Evaluations Platform, focusing on various evaluation pillars
- Conduct continuous discovery with teams to design a platform that allows self-measurement and improvement of AI performance
- Lead the development of a world-class agentic testing system to facilitate the rapid and safe deployment of new AI capabilities
Required qualifications
- 4+ years of product management experience in a technology company, with at least 2 years focused on technical, platform, or data/ML products
- Solid understanding of the software development lifecycle and agile practices
- Experience conducting user discovery with technical audiences and translating findings into actionable roadmap decisions
- Experience with LLM-based products and familiarity with their evaluation methods
- Strong analytical skills to set metrics and adapt strategies based on evidence
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,123 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
