Senior LLM Systems Engineer

Job Summary

A company is looking for a Senior LLM Systems Engineer to help build their NeMo Microservice Platform.

Key Responsibilities

• Develop distributed cloud applications and microservices that scale to large models
• Create microservices for task-specific AI cloud services
• Implement core infrastructure for cloud-native AI evaluation and improve service stability and performance

Required Qualifications

• BS, Masters, or equivalent experience in computer science, computer architecture, or related field
• 5+ years of relevant experience
• Experience with microservices and cloud-native applications using HTTP REST, gRPC, protobuf, and JSON
• Strong Python programming and software design skills
• Understanding of performance, security, and reliability in complex distributed infrastructure