AI/ML Infrastructure Engineer

Job Summary

To support the deployment of AI at scale, the full-time AI/ML Infrastructure Engineer will build and operate inference systems, ensuring fast, reliable, and cost-effective responses for community members while working remotely or from Seattle, WA.

Key responsibilities

• Build and operate inference systems that serve models and reasoning components
• Optimize latency and performance to deliver low-latency responses under load
• Ensure scalability and reliability of inference systems while managing costs effectively

Required qualifications

• Five or more years in infrastructure, systems, or ML infrastructure engineering
• Hands-on experience serving ML or LLM models in production at scale
• Deep understanding of latency, throughput, and performance optimization
• Experience with GPUs or accelerators and their efficient use
• Strong systems programming and distributed systems fundamentals