Software Engineer Code Reviewer
Location: Remote
Compensation: To Be Discussed
Reviewed: Fri, Oct 02, 2026
This job expires in: 30 days
Job Summary
Reviewing coding tasks and evaluation harnesses, the contract Software Engineer Code Reviewer will work remotely to assess the accuracy and complexity of programming challenges used for benchmarking AI agents.
Key responsibilities
- Review realistic programming tasks for accuracy and difficulty
- Verify the logic and test cases within provided evaluation harnesses
- Assess the effectiveness of coding environments in measuring software engineering skills
Required qualifications
- Active professional experience as a software engineer
- Hands-on experience building or maintaining test suites and evaluation harnesses
- Comfortable reviewing code and explaining technical concepts aloud
- Familiarity with complex real-world software architecture
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 41,592 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee