Senior Software Engineer

Job Summary

To support the evaluation of advanced AI systems, the freelance Senior Software Engineer will design and build scalable evaluation pipelines and frameworks, working remotely for 20-40 hours per week.

Key responsibilities

• Design and implement scalable evaluation pipelines for assessing AI model performance
• Develop automated testing harnesses and benchmarking tools for large language models
• Collaborate with AI researchers to translate evaluation methodologies into reliable software

Required qualifications

• 5+ years of professional software engineering experience with production systems
• Strong proficiency in Python and experience with data processing libraries
• Solid understanding of software architecture and engineering best practices
• Experience working with large datasets and building data pipelines
• Familiarity with cloud infrastructure and containerized deployments