Software Engineer - AI Evaluation
Location: Remote
Compensation: To Be Discussed
Reviewed: Wed, Jun 17, 2026
This job expires in: 29 days
Job Summary
Evaluating and benchmarking AI-generated code, the full-time Software Engineer - AI Evaluation will assess correctness, efficiency, and maintainability of coding solutions while working remotely on a contractor basis.
Key responsibilities
- Review and evaluate AI-generated code for correctness and adherence to requirements
- Analyze software engineering tasks and validate proposed solutions against expected outcomes
- Create and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks
Required qualifications
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field
- 3+ years of professional software engineering experience
- Strong proficiency in two or more programming languages such as Python, Java, or C/C++
- Experience performing code reviews and evaluating code quality in large-scale codebases
- Familiarity with version control systems and modern software development workflows
COMPLETE JOB DESCRIPTION
The job description is available to subscribers. Subscribe today to get the full benefits of a premium membership with Virtual Vocations. We offer the largest remote database online...