Principal Deep Learning Architect

Job Summary

A company is looking for a Principal Deep Learning Communication Architect.

Key Responsibilities

• Define the long-term technical roadmap for communication libraries across next-generation platforms
• Lead the development of next-generation communication primitives and collective algorithms
• Collaborate with application developers to implement specialized communication primitives for AI and HPC libraries

Required Qualifications

• Ph.D. or M.S. in Computer Science, Electrical Engineering, or a related field with 12+ years of industry experience in HPC or distributed deep learning
• Deep understanding of 3D parallelism and advanced strategies including Context Parallelism and ZeRO variants
• Technical proficiency with NCCL, UCX, UCC, NVSHMEM, or MPI
• Advanced knowledge of high-throughput inference engines and schedulers
• Expert knowledge of GPU memory hierarchy and CUDA programming models