Remote Jobs Sign In

Senior AI Benchmarking Expert

Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.

Location: Remote
Compensation: Piece Work
Reviewed: Sat, Nov 07, 2026
This job expires in: 30 days

Job Summary

Experienced coding, machine learning, or cybersecurity professionals will find a full-time opportunity as a Senior AI Benchmarking Expert, responsible for developing challenging tasks for AI benchmarks by identifying and translating complex problems into solvable tasks in a Linux terminal.

Key responsibilities
  • Identify difficult and meaningful problems in the candidate's area of expertise
  • Translate identified problems into tasks that can be executed in a Linux terminal
  • Design challenges that effectively expose limitations in advanced AI agents through rigorous testing
Required qualifications
  • At least 8 years of relevant professional experience in coding, machine learning, or cybersecurity
  • A completed master's degree or higher; candidates with a bachelor's degree and 10 years of experience plus a publication may also be considered
  • At least one academic or professional publication
  • Practical comfort working in a Linux terminal
  • Current residence in specified countries, including the United States, Canada, and several European nations

Complete Job Description

The complete job description is available to premium members. Premium membership includes:

Full access to 38,818 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee