Tech Lead - AI Inference

Job Summary

Leading a high-performing AI Inference team, the full-time Tech Lead - AI Inference will manage a squad of developers, balancing hands-on technical contributions with leadership to optimize Large Language Model (LLM) serving and drive execution on high-performance systems.

Key responsibilities

• Take end-to-end ownership of core inference infrastructure, driving technical decisions and delivery outcomes
• Guide engineers through the design, implementation, and delivery of high-throughput, low-latency LLM inference systems
• Mentor and coach engineers, fostering a culture of ownership, collaboration, and technical excellence within the team

Required qualifications

• 5+ years of professional software engineering experience, with a focus on AI/ML infrastructure or high-performance computing
• Hands-on expertise with LLM serving systems and familiarity with frameworks like vLLM and LMCache
• Strong Python and C++ skills, with knowledge of CUDA and high-performance I/O systems
• Experience deploying and scaling GPU workloads on Kubernetes and bare-metal GPU clusters
• Proven ability to mentor and develop engineers while balancing technical execution with team health