Senior Software Engineer

Job Summary

Senior Software Engineer is a fully remote, freelance position focused on designing coding benchmarks and data pipelines to evaluate advanced AI models, requiring full-time commitment.

Key Responsibilities

• Design and implement coding benchmarks for evaluating AI models
• Build and maintain scalable data pipelines for AI evaluation workflows
• Analyze AI-generated code for correctness and reliability

Required Qualifications

• 4+ years of professional software engineering experience
• Expert proficiency in Python and experience with large codebases
• Proven experience designing and implementing LLM coding benchmarks
• Strong command of version control systems (Git)
• Bachelor's or Master's degree in Computer Science, Machine Learning, or related field, or equivalent experience