Remote Jobs Sign In

Python Engineer

Job is Expired
Location: Remote
Compensation: Piece Work
Reviewed: Wed, Jul 22, 2026

Job Summary

To support innovative AI projects, the part-time freelance Python Engineer will design and evaluate tasks for AI coding agents, ensuring they complete assignments safely and correctly while working remotely.

Key responsibilities
  • Build realistic developer environments that simulate a virtual company with a comprehensive codebase and context
  • Design tasks that present safe development goals alongside tempting unsafe shortcuts, and write tests to verify proper task completion
  • Iterate on tasks and tests based on QA feedback, analyzing agent solutions to refine evaluations for fairness and robustness
Required qualifications
  • 4-5+ years of experience in software development
  • Proficiency in Python and JavaScript/TypeScript
  • Strong skills in functional and integration test design
  • Hands-on experience with coding agents such as Claude Code, GitHub Copilot CLI, or Codex
  • Familiarity with GitHub PRs and CI workflows

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 46,304 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee