Software Engineer - AI Automation
Job Summary
Focusing on developing tools to measure the performance of AI-powered software development solutions, the contract Software Engineer - AI Evaluation & Automation will build and scale automation tools, develop evaluation harnesses, and collaborate with engineering and data teams in a remote environment.
Key responsibilities
- Build and scale tooling for measuring the performance of AI-powered software development tools
- Develop evaluation harnesses and automate benchmark runs to ensure reproducibility of results
- Collaborate with teams to improve tooling and document evaluation processes
Required qualifications
- Strong software engineering background with experience in automation or developer tooling
- Proficient in Python and familiar with Java, JavaScript, or similar languages
- Solid knowledge of Git and experience with containerization using Docker
- Experience with APIs, CI/CD pipelines, and engineering workflows
- Some familiarity with AI evaluation processes and common pitfalls
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 42,189 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
