Staff HPC Engineer

Job Summary

Seeking a full-time Staff HPC Engineer, the successful candidate will manage Slurm cluster architecture and multi-tenant scheduling policies while ensuring cluster reliability on both bare-metal and VM-based GPU nodes in a remote capacity.

Key Responsibilities

• Design, deploy, and operate production Slurm clusters, ensuring high availability and seamless upgrades
• Model physical fabric for GPU scheduling and enforce multi-tenant scheduling policies, including account management and resource limits
• Lead the implementation of Slinky on Kubernetes, integrating Slurm with Kubernetes workloads and managing GPU resource allocation

Required Qualifications

• 8+ years in HPC, systems, or cloud infrastructure engineering, with 4+ years of experience operating production Slurm clusters at scale
• Deep hands-on expertise with Slurm configuration and management, including authentication and version upgrades on live clusters
• Strong knowledge of GPU and fabric fundamentals, including NVIDIA drivers and InfiniBand/RoCE technologies
• Experience with Kubernetes and Slurm-on-Kubernetes stacks, along with automation tools like Terraform and Ansible
• Proficient in Python and Bash for cluster automation, with additional experience in Go being a plus