Senior QA Engineer

Job Summary

Owning the quality assurance for voice agents in a remote full-time Senior QA Engineer role, the candidate will manage testing and debugging of voice interactions, establish release criteria, and ensure quality in production for systems that engage with real patients and providers.

Key responsibilities

• Conduct voice testing and debugging to isolate failures across various system layers
• Implement evaluation and regression testing, maintaining accuracy and reliability despite model changes
• Establish release criteria and monitor quality in production, addressing issues proactively before client impact

Required qualifications

• Experience in QA for production voice agents, with a proven ability to diagnose failures
• Background in QA for language model systems in a production environment
• Strong classical QA expertise, including test strategy, planning, and bug triage
• Proficiency in Python and test automation, capable of integrating tools into CI
• Ability to assess the severity of defects and communicate effectively with engineering teams