Senior Staff Engineer - ML Inference

Job Summary

Owning the cutting edge of machine learning, the remote Senior Staff Engineer - ML Inference will architect, optimize, and manage high-performance runtime systems to enhance ML inference for millions of merchants, driving significant cost and latency reductions.

Key responsibilities

• Architect, optimize, and own the production ML inference system for high throughput and ultra-low latency
• Leverage technologies like CUDA and TensorRT to deliver state-of-the-art performance and efficiency
• Collaborate with cross-functional teams to deploy and scale innovative ML models on the platform

Required qualifications

• Hands-on expertise in building and optimizing large-scale ML inference systems with measurable performance improvements
• Deep experience in production model serving and acceleration, particularly with GPUs
• Strong software engineering skills in Python, C++, or similar languages with a focus on distributed computing
• Proven leadership in architecting real-time inference systems handling high query volumes
• Advanced knowledge of model compression and efficient deployment strategies