Research Scientist

Job Summary

Focused on advancing the understanding and evaluation of large language models, the full-time remote Research Scientist will conduct original research, design experiments, and develop evaluation frameworks while collaborating with product and engineering teams.

Key responsibilities

• Own and pursue a research agenda centered on LLM evaluation, model quality, and routing optimization
• Design novel evaluation frameworks and benchmarks using real-world generation data to assess model performance
• Conduct large-scale empirical studies on LLM behavior and identify opportunities to apply research findings to OpenRouter's product

Required qualifications

• MS or PhD in a quantitative field such as machine learning, statistics, or computer science
• Track record of original research with first-author publications or significant contributions in industry research
• Deep expertise in statistics, experimental design, and causal inference
• Strong programming skills in Python and proficiency in SQL for large-scale analytical databases
• Hands-on experience with modern ML/NLP techniques and familiarity with the current LLM landscape