Remote Jobs Sign In

Senior Software Engineer

Location: Remote
Compensation: Hourly
Reviewed: Wed, Sep 30, 2026
This job expires in: 30 days

Job Summary

Evaluating the quality of interactions with modern coding agents, the contract Senior Software Engineer will work remotely to assess AI-generated coding outputs, focusing on their usefulness and alignment with strong engineering judgment for 10-20 hours per week.

Key responsibilities
  • Evaluate AI-generated coding interactions end to end, judging outputs for usefulness and correctness
  • Assess the quality of explanations and reasoning provided by AI coding agents
  • Provide clear, opinionated feedback on the interactions, defining what excellent performance looks like
Required qualifications
  • Senior, Staff, or Principal-level engineer (or equivalent experience)
  • Strong background in TypeScript/JavaScript or Python
  • Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor
  • Deep familiarity with modern AI-assisted development workflows
  • Strong written and spoken English (B2 or above) for detailed feedback and video explanations

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 40,123 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee