Machine Learning Engineer

Job Summary

Designing and optimizing large-scale model serving systems, the full-time Machine Learning System Engineer will manage distributed infrastructure, optimize latency and throughput, and build reliable serving systems in a remote environment.

Key responsibilities

• Architect and implement scalable distributed infrastructure for model serving, including load balancing and auto-scaling
• Optimize latency and throughput of model inference under real production workloads
• Create robust CI/CD infrastructure for seamless model deployment and inference engine updates

Required qualifications

• 3+ years of software engineering experience
• Deep low-level systems programming experience in C/C++ or Rust
• Experience with large-scale, high-concurrent production serving
• Experience with GPU inference engines (e.g., vLLM, Triton, TensorRT-LLM)