Senior Software Engineer

Job Summary

Senior Software Engineer is a fully remote, hourly contract role focused on designing coding benchmarks and data pipelines to evaluate advanced AI models, requiring full-time availability.

Key Responsibilities

• Design and implement coding benchmarks for evaluating AI models across programming tasks
• Build and maintain scalable data pipelines for AI evaluation workflows
• Analyze AI-generated code for correctness and reliability, and create structured evaluation scenarios

Required Qualifications

• 4+ years of professional software engineering experience
• Expert proficiency in Python and experience with large, complex codebases
• Proven experience designing and implementing coding benchmarks and data pipelines
• Strong command of version control systems (Git) and modern development workflows
• Bachelor's or Master's degree in Computer Science, Machine Learning, or a related field or equivalent professional experience