Principal Engineer, AI Orchestration
Location: Remote
Compensation: To Be Discussed
Reviewed: Fri, Aug 21, 2026
This job expires in: 20 days
Job Summary
To support a growing AI initiative, the full-time Principal Engineer, AI Orchestration will design and implement orchestration layers and retrieval systems for an enterprise AI platform, working remotely from King of Prussia, PA.
Key responsibilities
- Design the orchestration and abstraction layers connecting LLMs to tools, data, and sub-agents
- Build and operate Model Context Protocol (MCP) servers while defining standards for tool exposure and versioning
- Establish retrieval systems and evaluate orchestration quality, ensuring safety and access control across tools and agents
Required qualifications
- 12+ years of experience in software/AI engineering with expertise in LLM orchestration and retrieval systems
- Hands-on experience with LLM orchestration frameworks and building MCP servers
- Proven ability to design tool-surface strategies and evaluate agentic workflows
- Deep knowledge of retrieval strategies, embeddings, and context-window management
- Experience in creating abstraction layers and platform APIs for cross-team use
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 43,976 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee