Applied Research Scientist, LLM Evaluation

Job Summary

A company is looking for an Applied Research Scientist, LLM Evaluation & Post-Training.

Key Responsibilities

• Define and execute a research agenda focused on LLM evaluation and post-training
• Design rigorous experiments to study how evaluation methodologies impact fine-tuning and post-training outcomes
• Collaborate with AI/ML Research Engineers and Language Data Scientists to translate research methods into scalable evaluation and post-training pipelines

Required Qualifications

• MS/PhD in Computer Science, Machine Learning, Statistics, Applied Mathematics, AI, or a related quantitative scientific field (PhD strongly preferred)
• 5+ years of relevant experience in applied research/research science in ML/AI, with substantial work in LLMs or foundation models
• Demonstrated experience with LLM evaluation, benchmarking, alignment, and post-training research
• Strong coding skills in Python for research experimentation and analysis
• Experience working with modern ML tooling/frameworks (e.g., PyTorch, Hugging Face, JAX/TensorFlow)