Staff Software Engineer

Job Summary

To define and drive architecture for a high-throughput, low-latency multi-tenant ML inference platform, the full-time Staff Software Engineer will balance hands-on coding with long-term technical direction while working remotely or onsite in Pittsburgh, PA.

Key responsibilities

• Design platform architecture for multi-tenant inference workloads, including serving, orchestration, and APIs
• Develop robust API layers and developer SDKs to streamline distributed inference orchestration
• Build and optimize a multi-tenant control plane for accurate metering, rate limiting, and tenant isolation

Required qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 7+ years of experience building and operating backend distributed systems end to end
• Demonstrated technical leadership in backend distributed systems or ML infrastructure
• Strong fundamentals in data-intensive distributed systems and performance profiling
• Hands-on experience with large-scale inference services on GPUs and familiarity with inference engines or serving frameworks