Principal Engineer, Memory Systems

Job Summary

To own the technical vision and roadmap for the memory and storage layer of DigitalOcean's inference platform, the full-time Principal Engineer, Memory Systems will define a unified memory architecture, drive deep integrations with serving engines, and partner with cross-functional teams to optimize performance and cost in a remote work environment.

Key responsibilities

• Defining and evolving a unified memory layer for large-scale LLM inference
• Architecting integrations with production serving engines focused on cache management
• Driving unit economics through modeling and validating cache performance metrics

Required qualifications

• 15+ years of experience in building large-scale distributed systems or ML infrastructure
• Deep fluency in memory hierarchies and experience designing performance-optimized systems
• Experience with distributed caching or key-value systems optimized for low latency
• Strong systems programming skills in C/C++, Go, Rust, or Python
• Rigor in profiling and optimization across CPU, GPU, memory, and network