Technical Staff Member, Applied AI
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Job Summary
To develop, evaluate, and improve AI agents and LLM-powered systems in real-world enterprise workflows, the full-time remote Member of Technical Staff, Applied AI will design evaluation frameworks, conduct failure analysis, and run rapid experiments while collaborating with researchers and enterprise customers.
Key responsibilities
- Design and implement evaluation frameworks, benchmarks, and datasets for LLM-powered agents
- Identify, analyze, and prioritize model and workflow failures in production environments
- Run experiments to validate hypotheses and improve agent reliability and effectiveness
Required qualifications
- Strong background in applied AI research or research engineering
- Hands-on experience designing evaluations for AI agents and workflows
- Proficient in Python programming with experience in building evaluation pipelines
- Experience developing benchmarks, datasets, and experimental methodologies for AI systems
- Ability to analyze agent failures and translate findings into performance improvements
Complete Job Description
The complete job description is available to premium members. Premium membership includes:
Full access to 38,818 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to premium members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
