Applied AI Engineer
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Location: Remote
Compensation: To Be Discussed
Reviewed: Thu, Oct 29, 2026
This job expires in: 30 days
Job Summary
Owning the quality, safety, and performance of AI-powered consumer features, the full-time Applied AI Engineer will leverage Python and Java backend engineering along with hands-on LLM experience while working remotely.
Key responsibilities
- Own and improve system prompts and evaluation frameworks for AI features, ensuring reliability and trustworthiness
- Design and monitor guardrails for compliance and security, collaborating with legal and compliance teams
- Build tools for Conversation Analysts and QA engineers to enhance evaluation and testing processes
Required qualifications
- Bachelor's or Master's in Computer Science, Engineering, or a related field with professional software engineering experience
- Proven experience in building and operating LLM-powered applications in production
- Demonstrated experience in creating evaluations for LLM systems, including test sets and regression suites
- Working knowledge of Amazon Bedrock or similar LLM platforms and AWS services
- Proficient in SQL and experience analyzing production data in data warehouses like Amazon Redshift
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 38,895 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee