Senior Python Engineer

Job Summary

To evaluate AI coding agents, the part-time freelance Senior Python Engineer will create realistic developer environments, design and iterate on challenging tasks, and write tests to verify agent solutions while working remotely.

Key responsibilities

• Build realistic developer environments with a virtual company context
• Design tasks and evaluation criteria to assess AI agent performance
• Write and refine tests that verify the correctness of agent solutions based on QA feedback

Required qualifications

• 8+ years of experience in software development
• Proficiency in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis
• Experience in writing functional and integration tests
• English proficiency at B2 level or higher