Senior AI Engineer

Job Summary

To support a cutting-edge AI initiative, the full-time Senior AI Engineer will design and implement AI evaluation systems, develop scalable backend solutions, and drive product innovation in a remote work environment.

Key Responsibilities:

• Design, build, and own ClickUp's AI evaluation system, including golden datasets and automated scoring mechanisms
• Architect and implement scalable AI platform services that support the lifecycle management of LLMs and other AI models
• Collaborate cross-functionally to deliver seamless and reliable AI experiences integrated into ClickUp's core platform

Required Qualifications:

• 5+ years of software engineering experience, including 2+ years building production LLM or ML systems
• Hands-on experience with LLM evaluation systems tied to real product quality
• Strong experiment design skills, including A/B testing and statistical analysis
• Proven experience integrating and managing multiple LLMs with a focus on cost, latency, and quality tradeoffs
• Deep expertise in backend engineering and cloud-native technologies such as Kubernetes and AWS/GCP/Azure