Software Engineer, Distributed Systems

Job Summary

Experienced software engineers will find a full-time remote opportunity as a Software Engineer, Distributed Systems, focused on building and evolving a core platform for AI workload orchestration, scheduling, and large-scale storage.

Key responsibilities

• Build the core Python/Rust platform, including request routing, GPU autoscaling, and queueing
• Produce forward designs for platform evolution to accommodate a 100x increase in traffic while ensuring low latency globally
• Leverage AI to automate the development of complex and reliable systems, while profiling and tuning CPU and memory performance

Required qualifications

• 5+ years of experience in building distributed compute and orchestration platforms using Python or Rust
• Strong understanding of distributed systems fundamentals, including consensus, scheduling, and fault tolerance
• Deep knowledge of computational complexity and memory allocation
• Proven track record of designing scalable systems under real production loads
• Experience with observability to enhance performance and reliability