Staff Engineer, Inference Optimization

Job Summary

Seeking a full-time Staff Engineer, Inference Optimization, who will lead the technical strategy for performance architecture, engineer solutions for complex performance issues, and implement cutting-edge optimization techniques in a remote environment.

Key responsibilities

• Lead the technical strategy for benchmarking and performance optimizations at the inference engine and GPU kernel layers
• Engineer solutions for complex performance issues, including attention layer optimizations and advanced parallelization across multi-node GPU clusters
• Act as the subject matter expert on modern GPU families and their software stacks, advising on hardware procurement and software integration

Required qualifications

• 5+ years of experience in high-performance computing or AI infrastructure
• Deep familiarity with the Gen AI landscape, including major model families
• Hands-on experience with attention-layer optimizations and parallelization strategies across distributed GPU environments
• Comprehensive understanding of NVIDIA and AMD GPU architectures and their software ecosystems
• Expert-level proficiency in Triton or CUDA, with experience in contributing to open-source software projects