Remote Jobs Sign In

Senior GPU Infrastructure Engineer

Location: Remote
Compensation: To Be Discussed
Reviewed: Wed, Oct 14, 2026
This job expires in: 30 days

Job Summary

To ensure maximum uptime for large-scale AI workloads, the full-time Senior GPU Infrastructure Engineer will own the reliability and performance of the GPU platform, managing telemetry, automated diagnostics, and orchestration in a remote work environment.

Key responsibilities
  • Act as the technical escalation point for hardware issues, conducting deep root-cause analysis and managing automated diagnostics
  • Optimize high-performance networking and storage integration to prevent GPU starvation during multi-node training runs
  • Lead incident management efforts, including major incident response and conducting blameless post-mortems to drive operational excellence
Required qualifications
  • 5+ years of experience in SRE, Systems Engineering, or Infrastructure Engineering in high-density Linux environments
  • 3+ years of hands-on experience with data center class NVIDIA GPUs in distributed settings
  • Advanced proficiency in Kubernetes administration and orchestration
  • Strong programming skills in Python, Go, or Bash, with experience in Terraform and Ansible
  • In-depth knowledge of InfiniBand and RoCEv2 networking technologies

Complete Job Description

The complete job description is available to members. Premium membership includes:

Full access to 40,222 remote jobs from human-vetted companies, updated daily

Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job

Twice-monthly live group coaching and the full Remote Career Center

20% member discount on Career Services

Backed by a 30-day money-back guarantee