AI Product Analyst

Job Summary

Evaluating and improving Voice AI systems, the full-time AI Product Analyst will analyze production behavior, investigate inconsistencies, and design evaluation frameworks while working remotely in a fast-paced medical tech environment.

Key responsibilities

• Analyze production behavior of Voice AI Agents and conversational AI workflows
• Investigate hallucinations, inconsistencies, and quality degradation in AI-driven conversations
• Design evaluation frameworks for measuring AI quality, reliability, and business impact

Required qualifications

• 3+ years of experience in Product Analytics, Data Analytics, or similar roles within complex production systems
• Strong SQL skills and proficiency in Python for analytical investigations
• Understanding of LLM limitations, hallucinations, and AI failure modes
• Experience building monitoring systems or operational dashboards
• Fluent in Russian with English level B2 or higher