Senior Machine Learning Engineer

Job Summary

Designing and optimizing large-scale model serving systems, the full-time Senior Machine Learning Systems Engineer will architect distributed infrastructure, optimize model inference, and build reliable serving systems while working remotely or onsite.

Key responsibilities

• Architect and implement scalable distributed infrastructure for model serving, including load balancing and auto-scaling
• Optimize latency and throughput of model inference under real production workloads
• Create robust CI/CD infrastructure for seamless model deployment and inference engine updates

Required qualifications

• 5+ years of software engineering experience, with 2+ years in system performance optimization
• Deep low-level systems programming experience in C/C++ or Rust
• Experience with large-scale, high-concurrent production serving
• Familiarity with GPU inference engines such as vLLM, SGLang, or TensorRT-LLM
• Strong background in system optimizations, including batching, caching, and load balancing