Assessment Design Lead

Job Summary

Defining assessment strategies for language proficiency, the full-time remote Assessment Design Lead will focus on creating and validating assessment types, ensuring alignment with proficiency standards, and collaborating closely with product and machine learning teams to enhance scoring models.

Key responsibilities

• Own Assessment Design by defining assessment types and ensuring clarity in measuring constructs like fluency and pronunciation
• Develop rubrics and blueprints that translate qualitative goals into measurable constructs for assessment items
• Ensure content validity and quality by auditing assessments and maintaining fairness across diverse learner populations

Required qualifications

• 4+ years of experience in assessment or psychometric design for language assessment products
• Deep understanding of language proficiency frameworks such as CEFR or ACTFL
• Experience in ensuring fairness across learner populations and identifying biases in assessments
• Ability to translate qualitative constructs into concrete, scoreable metrics for machine learning applications
• Comfort with statistical methods related to assessment reliability and validity