Software Engineering Director

Job Summary

Leading a team of engineers, the full-time Software Engineering Director will focus on enhancing agent evaluations for software vendors, managing the evaluation system, and applying agentic engineering techniques in a remote environment.

Key responsibilities:

• Build and enhance agent evaluations that run against live agents, ensuring credible assessments and efficient onboarding processes
• Own the full stack of the core evaluation system, from administration to workflow dispatch, while collaborating with data science teams
• Facilitate the growth and mentorship of engineers, providing technical leadership and influencing the use of evaluations in agent-oriented products

Required qualifications:

• 10+ years of professional programming experience in backend or full-stack environments
• 2+ years of experience directly managing engineers
• Expert-level proficiency in backend development using languages such as Python, Java/Kotlin, or Typescript/Javascript
• Direct experience creating evaluations against customer-facing agents using agent trajectory trace data
• BS/BA degree in a related field