Senior Machine Learning Engineer

Job Summary

A company is looking for a Senior Machine Learning Engineer - AI Eval & Safety.

Key Responsibilities

• Architect and develop large-scale evaluation platforms for LLMs and agents
• Define standards and metrics for evaluating LLMs and agents
• Collaborate with stakeholders to translate evaluation goals into measurable frameworks

Required Qualifications

• 5+ years of ML engineering experience, with 3+ years in large-scale evaluation of LLMs
• Proven experience in building evaluation platforms across various contexts
• Deep expertise in designing LLM evaluation metrics
• Strong background in scalable platform engineering, including APIs and pipelines
• Proficiency in Python, PyTorch, and modern ML ops environments