Applied AI Engineer
Job Summary
To support the advancement of healthcare infrastructure, the full-time Applied AI Engineer will build and manage production-level LLM-based agents, oversee agent runtime and orchestration, and ensure robust evaluation and observability of AI systems while working remotely.
Key responsibilities:
- Build and run production agents that users rely on, focusing on LLM-based systems
- Design and implement agent runtime, including failure handling and context management
- Develop evaluation sets and testing frameworks to measure AI system performance and catch regressions
Required qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related technical field
- 5 to 15+ years of software engineering experience with proven production LLM experience
- Hands-on expertise in at least one core area: agent runtime, evaluation, retrieval, or observability and cost
- Experience in measuring AI system effectiveness using evaluation data
- Strong production engineering skills across testing, debugging, and deployment
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 38,620 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
BBB URL BBB URL
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
