Senior ML Evaluation Engineer

Job Summary

A company is looking for a Senior ML Evaluation Engineer - Autonomous Vehicles.

Key Responsibilities

• Design and build learned evaluation pipelines for assessing driving behavior using LLMs, VLMs, and multimodal models
• Develop workflows that chain model inference and structured reasoning to evaluate complex driving scenarios
• Build frameworks for evaluation methodology and contribute to transitioning from rule-based to learned evaluation

Required Qualifications

• PhD with 4+ years, MS with 6+ years, or BS with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related field
• Hands-on experience with LLM/VLM-based pipelines and model fine-tuning
• Proven track record of shipping ML systems to production
• Strong software engineering fundamentals with proficiency in Python and C++
• Experience with evaluation methodologies and large-scale data processing