Product Manager, Toast IQ

Job Summary

As a full-time remote Product Manager for Toast IQ Evaluation, the candidate will define quality standards for restaurant operators, analyze real usage data, and develop actionable insights to enhance the Toast IQ assistant's performance.

Key responsibilities

• Understand the operator's experience by reviewing real Toast IQ sessions and gathering feedback directly from operators
• Identify and prioritize recurring failures, grouping observations into failure modes and assessing their impact on operators
• Build and maintain trustworthy evaluation datasets, ensuring accuracy and relevance for common workflows and known failures

Required qualifications

• Restaurant knowledge through direct experience or close collaboration with operators
• Strong attention to detail for managing and labeling large datasets accurately
• Ability to work with structured data, utilizing databases and queries to investigate findings
• Experience in precise thinking and writing to create clear definitions and scoring rules
• Curiosity about AI systems and a willingness to learn new evaluation methods