Music Notation QA Specialist
Location: Remote
Compensation: To Be Discussed
Reviewed: Thu, Sep 17, 2026
This job expires in: 30 days
Job Summary
Seeking a musically literate specialist, the contract-based Full Stack Producer (Music Notation, Audio ML) will evaluate the quality of AI models related to music notation and audio, contributing to QA and data labeling efforts across various projects while working remotely.
Key responsibilities
- Expert-score every OMR and A2S release each sprint and run deeper quarterly QA cycles with AB-tests
- Conduct quarterly competitor benchmarking against multiple competitors on the golden dataset and provide fast sanity checks on model candidates between releases
- Build and label the Autograde golden test set, extending the QA process to adjacent projects as they scale
Required qualifications
- Strong musical literacy with the ability to read and evaluate music notation, scores, and audio performances
- Experience judging OMR and audio-to-score transcription output for accuracy
- Familiarity with structured/rubric-based QA scoring methodology
- Comfortable evaluating a range of score types, including multilingual lyrics and various ensemble formats
- Attention to detail for spot-checking datasets against ground truth
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 41,741 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee