Senior Research Engineer

Job Summary

Passionate about Generative AI inference, the full-time Senior Research Engineer will design and evaluate routing policies for LLM traffic, build benchmarks to measure algorithm quality, and collaborate with engineering teams to ensure seamless software integration, with opportunities for remote work.

Key responsibilities

• Design and evaluate routing policies for LLM traffic to optimize model system usage
• Build and run agentic benchmarks to assess algorithm quality and develop routing profiles
• Collaborate with engineering teams to ensure integration across the NVIDIA accelerated serving stack

Required qualifications

• Bachelor's or Master's degree in Computer Science or equivalent experience
• 8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow)
• Experience designing or running LLM evaluations/benchmarks and drawing statistically sound conclusions
• Understanding of modern techniques in Machine Learning, Deep Neural Networks, or Natural Language Processing
• Strong computer science fundamentals, including algorithms, data structures, and parallel computing