Machine Learning Infrastructure Engineer

Job Summary

A company is looking for a Member of Technical Staff, Inference.

Key Responsibilities

• Productionize model checkpoints end-to-end from research to deployment
• Build and optimize inference systems for large-scale generative models
• Add monitoring and observability for new model releases

Required Qualifications

• 4+ years of experience running ML model inference in production environments
• Strong experience with PyTorch and multi-GPU inference
• Experience with Kubernetes for deploying and scaling GPU-based services
• Familiarity with monitoring and observability for ML systems
• Self-starter with a pragmatic approach to production reliability