Texas Licensed Senior Python Engineer

Job Summary

To support the evaluation of AI coding agents, a part-time freelance Texas Licensed Senior Python Engineer will create realistic developer environments, design evaluation tasks, and write tests to verify AI solutions while working remotely.

Key responsibilities

• Build realistic developer environments that simulate a virtual company with a codebase and context
• Design tasks and evaluation criteria to assess AI agents' performance on real-world developer tasks
• Write and iterate on tests to verify agent solutions based on QA feedback, ensuring fairness and robustness

Required qualifications

• 8+ years of experience in software development
• Proficiency in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis
• Experience in writing functional and integration tests
• English proficiency at a B2 level or higher