Manager of LLM Inference

Job Summary

A company is looking for a Manager, Large Language Model Inference.

Key Responsibilities

• Lead and grow a team focused on kernel development, runtime optimizations, and frameworks for LLM inference
• Drive the design, development, and delivery of production inference software for next-generation hardware platforms
• Manage software development execution, including project planning and cross-functional coordination

Required Qualifications

• MS, PhD, or equivalent experience in Computer Science, Computer Engineering, AI, or a related field
• 7+ years of software engineering experience, with 3+ years in technical leadership
• Proven ability to lead high-performing engineering teams across distributed groups
• Strong background in C++ or Python, with expertise in software design for production-quality software libraries
• Demonstrated expertise in large language models (LLM) and/or vision language models (VLM)