Senior Staff Engineer - ML Inference
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Location: Remote
Compensation: To Be Discussed
Reviewed: Mon, Nov 09, 2026
This job expires in: 30 days
Job Summary
Driving the advancement of machine learning, the remote Senior Staff Engineer - ML Inference will architect and optimize high-performance ML inference systems, ensuring rapid deployment and efficiency for millions of merchants.
Key responsibilities
- Architect, optimize, and own production ML inference for high throughput and ultra-low latency
- Leverage technologies like CUDA and TensorRT to achieve state-of-the-art performance at scale
- Collaborate with ML, infrastructure, and product teams to deploy and scale cutting-edge models
Required qualifications
- Proven expertise in building and optimizing large-scale ML inference systems
- Deep experience in production model serving and runtime optimization, especially with GPUs
- Strong software engineering skills in Python, C++, or other relevant languages
- Demonstrated leadership in architecting reliable, real-time inference systems
- Advanced understanding of model compression and deployment trade-offs
Complete Job Description
The complete job description is available to premium members. Premium membership includes:
Full access to 36,607 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee