Distinguished Engineer, AI Infrastructure
Location: Remote
Compensation: Salary
Reviewed: Tue, Aug 11, 2026
This job expires in: 27 days
Job Summary
Leading the development of global strategies for scaled-out AI inferencing, the full-time Distinguished Engineer, AI Infrastructure will architect distributed pipelines and model serving strategies for high-throughput and low-latency performance in both cloud and enterprise environments.
Key responsibilities
- Architect and implement distributed inference systems to support massive-scale AI workloads
- Collaborate on hardware-software co-optimization and performance tuning for production-grade model serving
- Orchestrate model lifecycles, leading strategies for deployment, versioning, and intelligent scaling across environments
Required qualifications
- 16+ years in technical roles with a focus on AI infrastructure and large-scale inference orchestration
- 7-10+ years of leadership experience
- BS/MS or higher in systems/software engineering or related fields
- Proficiency in GPU architecture, hardware acceleration, and cloud-native architectures for model serving
- Proven success in delivering complex solutions with transparency into resource utilization and performance
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 48,944 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee