Senior Python Engineer
Location: Remote
Compensation: Hourly
Reviewed: Wed, Sep 09, 2026
This job expires in: 30 days
Job Summary
Evaluating AI-generated coding interactions, the contract Senior Python Engineer will assess the quality of responses from coding agents like OpenAI Codex and Claude Code, focusing on engineering judgment and user experience in a remote role.
Key responsibilities
- Evaluate end-to-end interactions with AI coding agents, judging the usefulness and correctness of outputs
- Assess the quality of explanations and reasoning provided by the AI, offering clear feedback on performance
- Define standards for effective interactions with AI tools, establishing what constitutes high-quality engineering responses
Required qualifications
- Staff or Principal-level engineer or equivalent experience
- Strong background in Python, TypeScript, or JavaScript
- Hands-on experience with OpenAI Codex, Claude Code, or similar tools
- Deep familiarity with modern AI-assisted development workflows
- Ability to provide direct and opinionated feedback on engineering quality
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 41,185 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee