Senior Local LLM Engineer

Job Summary

Seeking a hands-on technical leader, the full-time Senior Local LLM Engineer will build and operate a secure local large-language-model platform, enabling the use of generative AI with proprietary data while ensuring sensitive information remains protected in a remote environment.

Key responsibilities:

• Own the architecture and technical roadmap for a secure local LLM platform deployed in company-controlled infrastructure
• Partner with cross-functional teams to prioritize high-value use cases and translate them into measurable product and platform requirements
• Design and operate retrieval-augmented generation (RAG) and enterprise-search pipelines for approved internal data sources

Required qualifications:

• BSc or MSc in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a related field, or equivalent practical experience
• Typically 7+ years of hands-on experience in production software, ML platform, search, data, or infrastructure engineering
• Strong Python engineering skills with experience in designing maintainable APIs and services
• Demonstrated experience building production RAG or enterprise-search systems using embeddings and systematic retrieval evaluation
• Experience deploying and operating containerized services on Linux using Docker and Kubernetes