Staff Software Engineer

Job Summary

Leading the development of a production inference platform, the remote Staff Software Engineer will define architecture, evaluate technologies, and build systems for model serving while optimizing performance and cost efficiency.

Key responsibilities

• Lead the design and development of the production inference platform
• Define the technical roadmap for inference infrastructure and model serving
• Build and operate scalable systems for serving large language models in production

Required qualifications

• Significant experience designing and operating production AI inference systems
• Deep experience with modern inference runtimes and frameworks such as vLLM or Triton Inference Server
• Strong background in distributed systems or high-performance platform engineering
• Proficiency in Python and at least one systems programming language (e.g., Go, Rust, C++)
• Proven ability to lead technical architecture for complex infrastructure initiatives