Senior AI Architect

Job Summary

Serving as a strategic advisor for language, reasoning, and evaluation-focused AI programs, the full-time Senior Computational AI Architect will design and validate annotation guidelines, evaluation rubrics, and quality frameworks while collaborating remotely with program managers and AI strategists.

Key responsibilities

• Develop annotation guidelines, create reviewer handbooks, and establish escalation frameworks for instruction design
• Design evaluation rubrics and define quality acceptance criteria for rubric development
• Review project instructions and guide localization efforts to improve linguistic consistency

Required qualifications

• Master's or PhD in Computational Linguistics, NLP, Linguistics, or Cognitive Science
• 8+ years of experience in relevant fields
• Expertise in NLP, LLM evaluation, and quality frameworks
• Strong written English and ability to communicate complex ideas clearly
• Comfortable working independently in a remote environment