AgenticOps Engineer

Job Summary

Working full-time as an AgenticOps Engineer, the successful candidate will monitor agent performance, diagnose output quality issues, and enhance prompt engineering across multiple product teams in a remote capacity.

Key responsibilities

• Continuously monitor agent output quality and identify recurring patterns to improve performance
• Own and iterate on the shared prompt infrastructure, developing a prompt playbook and integrating new model capabilities
• Provide escalation support for persistent agent output issues, diagnosing root causes and collaborating with Product Engineers to implement solutions

Required qualifications

• 5+ years of software engineering experience with strong fundamentals in systems thinking and debugging
• Hands-on experience with LLM APIs, including prompt design and function calling
• Proven ability to diagnose and resolve complex technical issues across teams
• Strong analytical skills, including experience in building dashboards and analyzing statistical patterns
• Excellent written and verbal communication skills for effective documentation and knowledge transfer