AI Infrastructure Engineer

Location: Remote
Compensation: Salary
Reviewed: Fri, May 22, 2026
This job expires in: 30 days

Job Summary

Seeking a skilled AI Infrastructure Engineer for a full-time remote position, responsible for designing and operating GPU infrastructure for large-scale AI training and inference, while ensuring reliability, efficiency, and cost control.

Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference across on-prem and cloud environments
  • Build scheduling and resource-sharing systems to maximize accelerator utilization for multiple teams
  • Integrate various ML frameworks into a unified platform and maintain high-performance storage systems and data pipelines
Required Qualifications
  • Bachelor's or Master's degree in Computer Science or a related field
  • Six or more years of experience in infrastructure, platform, or HPC engineering
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure
  • Strong proficiency in Python and at least one systems language such as Go or C++
  • Deep understanding of distributed training and accelerator architectures

COMPLETE JOB DESCRIPTION

The job description is available to subscribers. Subscribe today to get the full benefits of a premium membership with Virtual Vocations. We offer the largest remote database online...