Senior Software Engineer
Location: Remote
Compensation: Hourly
Reviewed: Wed, Sep 30, 2026
This job expires in: 30 days
Job Summary
Evaluating the quality of interactions with modern coding agents, the contract Senior Software Engineer will work remotely to assess AI-generated coding outputs, focusing on their usefulness and alignment with strong engineering judgment for 10-20 hours per week.
Key responsibilities
- Evaluate AI-generated coding interactions end to end, judging outputs for usefulness and correctness
- Assess the quality of explanations and reasoning provided by AI coding agents
- Provide clear, opinionated feedback on the interactions, defining what excellent performance looks like
Required qualifications
- Senior, Staff, or Principal-level engineer (or equivalent experience)
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor
- Deep familiarity with modern AI-assisted development workflows
- Strong written and spoken English (B2 or above) for detailed feedback and video explanations
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,123 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee