Remote Jobs Sign In

Senior LLM Operations Engineer

Location: Remote
Compensation: To Be Discussed
Reviewed: Thu, Aug 27, 2026
This job expires in: 30 days

Job Summary

To support the development of AI-native capabilities, the full-time Senior LLM Operations Engineer will design and operate orchestration systems, implement observability for AI workflows, and establish cost management strategies while working remotely.

Key Responsibilities
  • Design and operate LLM orchestration and runtime systems for reliable AI workflows
  • Build and maintain evaluation pipelines to measure the quality and impact of LLM-driven features
  • Implement observability for AI systems, including metrics and feedback loops
Required Qualifications
  • 8+ years of experience in software engineering, platform engineering, or DevOps roles
  • Hands-on experience operating LLM-powered systems in production
  • Strong understanding of distributed systems, APIs, and cloud-native architectures
  • Experience designing observability and evaluation systems for complex workflows
  • Proven ability to lead through influence and collaborate across teams

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 47,980 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee