Freelance Senior Python Engineer
Location: Remote
Compensation: Hourly
Reviewed: Mon, Aug 10, 2026
This job expires in: 23 days
Job Summary
Working remotely on a part-time freelance basis, a Senior Python Engineer will create and evaluate tasks for AI coding agents, building realistic developer environments and designing evaluation criteria to assess agent performance.
Key responsibilities
- Build realistic developer environments that simulate a virtual company with a codebase and context
- Design tasks and evaluation criteria to ensure AI agents can effectively solve developer challenges
- Write and iterate on tests that verify agent solutions, refining them based on quality assurance feedback
Required qualifications
- 8+ years of experience in software development
- Proficiency in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis
- Experience in writing functional and integration tests
- English proficiency at a B2 level or higher
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 44,720 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee