Senior Software Engineer

Job Summary

To support the evaluation of AI coding agents, the freelance Senior Software Engineer will create realistic developer environments and design tasks that challenge AI models while working remotely.

Key responsibilities

• Build realistic developer environments with a virtual company context, including codebase and infrastructure
• Design tasks and evaluation criteria to assess AI agent performance in solving developer tasks
• Write and iterate on tests that verify agent solutions based on QA feedback to ensure fair evaluations

Required qualifications

• 5+ years of experience in software development
• Proficiency in core technologies: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
• Experience in writing functional and integration tests
• English proficiency at a B2 level or higher
• Willingness to complete identity verification and a technical assessment as part of the onboarding process