Remote Jobs Sign In

Distinguished Engineer, AI Infrastructure

Location: Remote
Compensation: Salary
Reviewed: Tue, Aug 11, 2026
This job expires in: 27 days

Job Summary

Leading the development of global strategies for scaled-out AI inferencing, the full-time Distinguished Engineer, AI Infrastructure will architect distributed pipelines and model serving strategies for high-throughput and low-latency performance in both cloud and enterprise environments.

Key responsibilities
  • Architect and implement distributed inference systems to support massive-scale AI workloads
  • Collaborate on hardware-software co-optimization and performance tuning for production-grade model serving
  • Orchestrate model lifecycles, leading strategies for deployment, versioning, and intelligent scaling across environments
Required qualifications
  • 16+ years in technical roles with a focus on AI infrastructure and large-scale inference orchestration
  • 7-10+ years of leadership experience
  • BS/MS or higher in systems/software engineering or related fields
  • Proficiency in GPU architecture, hardware acceleration, and cloud-native architectures for model serving
  • Proven success in delivering complex solutions with transparency into resource utilization and performance

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 48,944 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee