Senior Software Engineer

Job Summary

Seeking a Senior Software Engineer to work remotely on a full-time basis, focusing on developing high-performance software for executing open-source large language models on custom hardware, leveraging modern C++ and advanced optimization techniques.

Key Responsibilities

• Design and implement high-performance inference software for LLMs on custom hardware
• Develop and optimize C++-based libraries utilizing SIMD instructions and efficient memory management
• Collaborate with FPGA and systems engineers to enhance data movement and computational offloading

Required Qualifications

• 7+ years of professional experience in C++ software development for performance-critical applications
• Strong understanding of C++ templates and modern memory management techniques
• Hands-on experience with SIMD programming and intrinsics-based vectorization
• Experience in high-performance computing or ML inference optimization
• Proficiency with systems-level software development and profiling tools