Senior Software Engineer - AI

Job Summary

A company is looking for a Senior Software Engineer - AI Inference.

Key Responsibilities

• Contribute features, fixes, and optimizations upstream to vLLM/SGLang
• Implement and optimize inference runtime capabilities for improved throughput and latency
• Profile and improve performance across layers, ensuring multi-GPU reliability and efficiency

Required Qualifications

• 5+ years of experience in building production software with a focus on performance and reliability
• Experience with LLM inference/serving stacks and understanding of production performance tradeoffs
• Strong programming skills in Python and C++ and/or CUDA
• Experience with performance profiling and investigation techniques
• BS/MS in Computer Science, Computer Engineering, or related field (or equivalent experience)