AI Solutions Consultant

Job Summary

As the technical backbone of AI Evaluations, the full-time AI Solutions Consultant will partner with Account Executives to scope, design, and win engagements that evaluate and red team chatbots, copilots, and AI agents, all while working remotely.

Key Responsibilities

• Partner with Account Executives to understand client AI systems and evaluation requirements through technical discovery calls
• Design tailored evaluation approaches and translate client requirements into structured Statements of Work and evaluation rubrics
• Collaborate with cross-functional teams to ensure a smooth transition from closed deals to active delivery

Required Qualifications

• 6-9 years of experience in a customer-facing technical role related to AI/LLM evaluation or red-teaming
• Hands-on experience with human-in-the-loop evaluation programs and adversarial red-teaming engagements
• Strong understanding of LLM failure modes and evaluation metrics
• Familiarity with adversarial testing methodologies and frameworks like OWASP LLM Top 10
• Bachelor's degree in Computer Science, Data Science, or a related field, or equivalent experience