Senior Software Engineer

Job Summary

Senior Software Engineer is a full-time, freelance remote position focused on designing and building coding benchmarks and data pipelines for evaluating advanced AI models.

Key Responsibilities

• Design and implement coding benchmarks for evaluating AI models on real-world programming tasks
• Build and maintain scalable data pipelines for AI evaluation workflows
• Analyze AI-generated code for correctness and reliability, and create structured evaluation scenarios

Required Qualifications

• 4+ years of professional software engineering experience
• Expert proficiency in Python and experience with large, complex codebases
• Proven experience designing and implementing LLM coding benchmarks and data pipelines
• Strong command of version control systems (Git) and modern development workflows
• Bachelor's or Master's degree in Computer Science, Machine Learning, or a related field or equivalent professional experience