Senior Software Engineer

Job Summary

A company is looking for a Senior Software Engineer, NIM Production.

Key Responsibilities

• Design, build, and optimize containerized inference execution for LLM applications
• Ensure performance and scalability of NIMs through comprehensive measurement and optimization
• Collaborate with teams to improve inference solutions and mentor team members

Required Qualifications

• A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience
• 6+ years of experience in developing performant microservices, cloud software, and/or tooling roles
• Deep technical expertise in distributed containerized applications using Docker, Kubernetes, and Helm Charts
• Experience productionizing and deploying LLM models
• History of using advanced programming skills to build distributed compute systems and backend services