Senior Lead Machine Learning Engineer

Job Summary

A company is looking for a Sr Lead Machine Learning Engineer.

Key Responsibilities

• Design and implement evaluation frameworks for agentic systems focusing on human+AI collaboration
• Build benchmarking pipelines to capture success indicators such as trust calibration and agent handoff quality
• Lead development of tools for analyzing agent behavior and ensure reproducible evaluation across AI initiatives

Required Qualifications

• Proven experience in designing evaluation systems for agentic or LLM-based AI
• Deep expertise in statistical experimentation and human-AI interaction assessment
• Fluency in building data pipelines using Python, SQL, and distributed data processing frameworks
• Demonstrated ability to influence product and model roadmaps through evaluation insights
• Adaptive-level proficiency in integrating AI tools into technical workflows