QA Analyst for LOIS

Job Summary

Owning the quality assurance function for LOIS for Word, the full-time remote QA Analyst will define test strategies, evaluate AI output accuracy, and collaborate with product and engineering teams to ensure quality is integrated from the start of feature development.

Key responsibilities:

• Define and own the test strategy, process, and QA playbook for the product
• Evaluate AI output quality and design evaluation sets to catch regressions over time
• Build automated guardrails integrated into CI/CD that cover critical flows

Required qualifications:

• 2+ years of QA experience, including ownership of test strategy for a product or major feature area
• Track record of building QA processes and automation from scratch in a fast-moving environment
• Strong analytical skills with a focus on both functional correctness and AI output quality
• Ability to reason about non-deterministic systems and define what "correct" means in ambiguous scenarios
• Experience with bug tracking tools and test management workflows