Remote Jobs Sign In

Software Engineer - AI Evaluation

Location: Remote
Compensation: To Be Discussed
Reviewed: Wed, Jun 17, 2026
This job expires in: 29 days

Job Summary

Evaluating and benchmarking AI-generated code, the full-time Software Engineer - AI Evaluation will assess correctness, efficiency, and maintainability of coding solutions while working remotely on a contractor basis.

Key responsibilities
  • Review and evaluate AI-generated code for correctness and adherence to requirements
  • Analyze software engineering tasks and validate proposed solutions against expected outcomes
  • Create and maintain evaluation datasets, benchmarks, and grading rubrics for coding tasks
Required qualifications
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field
  • 3+ years of professional software engineering experience
  • Strong proficiency in two or more programming languages such as Python, Java, or C/C++
  • Experience performing code reviews and evaluating code quality in large-scale codebases
  • Familiarity with version control systems and modern software development workflows

COMPLETE JOB DESCRIPTION

The job description is available to subscribers. Subscribe today to get the full benefits of a premium membership with Virtual Vocations. We offer the largest remote database online...