Senior GPU Infrastructure Engineer
Location: Remote
Compensation: To Be Discussed
Reviewed: Wed, Oct 14, 2026
This job expires in: 30 days
Job Summary
To ensure maximum uptime for large-scale AI workloads, the full-time Senior GPU Infrastructure Engineer will own the reliability and performance of the GPU platform, managing telemetry, automated diagnostics, and orchestration in a remote work environment.
Key responsibilities
- Act as the technical escalation point for hardware issues, conducting deep root-cause analysis and managing automated diagnostics
- Optimize high-performance networking and storage integration to prevent GPU starvation during multi-node training runs
- Lead incident management efforts, including major incident response and conducting blameless post-mortems to drive operational excellence
Required qualifications
- 5+ years of experience in SRE, Systems Engineering, or Infrastructure Engineering in high-density Linux environments
- 3+ years of hands-on experience with data center class NVIDIA GPUs in distributed settings
- Advanced proficiency in Kubernetes administration and orchestration
- Strong programming skills in Python, Go, or Bash, with experience in Terraform and Ansible
- In-depth knowledge of InfiniBand and RoCEv2 networking technologies
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,222 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee