Machine Learning Engineer

Job Summary

Seeking a highly skilled Machine Learning Engineer specializing in Large Language Models (LLMs) for automated evaluation and quality assessment, this full-time remote position will design and implement systems to measure and improve model output accuracy, relevance, and consistency while collaborating with cross-functional teams.

Key responsibilities

• Design and implement automated systems and pipelines for evaluating LLM outputs
• Develop metrics and KPIs to measure output quality, accuracy, and consistency
• Collaborate with Engineering teams to create automated logic checks and validation tools

Required qualifications

• 5+ years of experience in ML engineering, NLP, or AI/ML automation
• Hands-on experience in prompt engineering and designing LLM-based evaluation systems
• Strong understanding of machine learning principles with a focus on NLP and advanced LLM capabilities
• Expertise in building automated evaluation or QA pipelines
• Bachelor's/Master's degree in Computer Science/Engineering or a related field