Senior Software Engineer II

Job Summary

Owning agent quality end-to-end, the remote Senior Software Engineer II will diagnose, improve, and validate SmartAssist's orchestrator and subagents while driving quality enhancements through prompt and context engineering.

Key responsibilities

• Identify and prioritize failure modes across various quality dimensions, including factual accuracy and latency
• Drive quality improvements through the development of evaluation frameworks and methodologies
• Collaborate with cross-functional teams to ensure measurable quality signals for every change implemented

Required qualifications

• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
• Deep experience with prompt and context engineering, understanding model behavior changes
• Strong knowledge of RAG architectures and experience building LLM evaluation frameworks
• Fluency in agent system design and strong Python skills in data-heavy environments
• BS or MS in Computer Science, a related field, or equivalent industry experience