Remote Jobs Sign In

Senior Staff Engineer - ML Inference

Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.

Location: Remote
Compensation: To Be Discussed
Reviewed: Mon, Nov 09, 2026
This job expires in: 30 days

Job Summary

Driving the advancement of machine learning, the remote Senior Staff Engineer - ML Inference will architect and optimize high-performance ML inference systems, ensuring rapid deployment and efficiency for millions of merchants.

Key responsibilities
  • Architect, optimize, and own production ML inference for high throughput and ultra-low latency
  • Leverage technologies like CUDA and TensorRT to achieve state-of-the-art performance at scale
  • Collaborate with ML, infrastructure, and product teams to deploy and scale cutting-edge models
Required qualifications
  • Proven expertise in building and optimizing large-scale ML inference systems
  • Deep experience in production model serving and runtime optimization, especially with GPUs
  • Strong software engineering skills in Python, C++, or other relevant languages
  • Demonstrated leadership in architecting reliable, real-time inference systems
  • Advanced understanding of model compression and deployment trade-offs

Complete Job Description

The complete job description is available to premium members. Premium membership includes:

Full access to 36,607 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee