Senior Software Engineer

Job Summary

A company is looking for a Senior Software Engineer - TensorRT Edge-LLM.

Key Responsibilities

• Develop and enhance an inference framework in modern C++ for autoregressive model serving
• Design and implement optimizations for transformer-based models on real-time platforms
• Collaborate with cross-functional teams to deliver high-performance solutions and optimize inference performance

Required Qualifications

• BS, MS, PhD, or equivalent experience in Computer Science, Electrical/Computer Engineering, or a related field
• 4+ years of relevant software development experience
• Deep understanding of transformer models and inference optimization techniques
• Proficient in modern C++ (C++11/14/17 and beyond)
• Familiarity with popular LLM frameworks and libraries