Senior Machine Learning Engineer

Job Summary

A company is looking for a Senior Principal Machine Learning Engineer focused on vLLM Inference.

Key Responsibilities

• Write robust Python and C++ for vLLM systems and performance analysis
• Contribute to the design and testing of inference optimization algorithms
• Act as a core contributor to the vLLM open-source project and mentor other engineers

Required Qualifications

• Extensive experience in high performance code for GPUs and knowledge of GPU hardware
• Strong understanding of computer architecture, parallel processing, and distributed computing
• Experience with tensor math libraries such as PyTorch
• Deep understanding of LLM Inference Optimization fundamentals
• BS, MS, or PhD in computer science, computer engineering, or a related field