Remote Jobs Sign In

Senior Director of Inference Products

Location: Remote
Compensation: Salary
Reviewed: Thu, Jul 16, 2026
This job expires in: 30 days

Job Summary

Leading a high-performing engineering team, the full-time Senior Director of Inference Products will manage DigitalOcean's inference product suite, including Serverless Inference and Dedicated Inference, while ensuring robust, cost-efficient systems that serve millions globally in a remote environment.

Key responsibilities
  • Recruit, mentor, and coach engineers to foster a culture of ownership and technical excellence
  • Define and execute the product roadmap for all inference products in collaboration with product teams
  • Lead the design and evolution of the inference serving stack, optimizing performance and resource utilization
Required qualifications
  • 10+ years of software engineering experience, with 6+ years in a technical leadership role in Inference Systems or AI/ML
  • Deep expertise in distributed systems design and modern AI/ML technologies
  • Strategic knowledge of GPU architectures and their impact on AI performance
  • Familiarity with container runtime internals and security concepts in shared infrastructure
  • Proven ability to translate complex technical requirements into user-focused product features

COMPLETE JOB DESCRIPTION

The job description is available to subscribers. Subscribe today to get the full benefits of a premium membership with Virtual Vocations. We offer the largest remote database online...