Remote Jobs Sign In

Senior Python Engineer

Location: Remote
Compensation: Hourly
Reviewed: Mon, Aug 10, 2026
This job expires in: 25 days

Job Summary

To evaluate AI coding agents, the part-time freelance Senior Python Engineer will create realistic developer environments, design and iterate on tasks, and write tests to verify agent solutions while working remotely.

Key responsibilities
  • Build realistic developer environments that simulate a virtual company with a codebase and context
  • Design tasks and evaluation criteria, ensuring they are solvable by AI agents
  • Write and refine tests that verify agent solutions based on QA feedback
Required qualifications
  • 8+ years of experience in software development
  • Proficiency in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis
  • Experience in writing functional and integration tests
  • English proficiency at B2 level or higher

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 46,074 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee