Senior Data Engineer

Job Summary

To support a growing cloud and infrastructure team, the full-time Senior Data Engineer will build source connectors and ingestion pipelines for transforming raw knowledge content into a governed corpus in S3 and Amazon Bedrock Knowledge Bases, working remotely and collaborating closely with retrieval engineers.

Key responsibilities

• Build connectors for Oracle B2C Service, SharePoint, OneDrive, Teams, and Sitecore, ensuring proper data extraction and permission metadata capture
• Implement the ingestion pipeline for S3, including document conversion, metadata enrichment, and sync with Bedrock Knowledge Base
• Instrument pipeline stages with CloudWatch metrics and create ingestion runbooks for client IT transition support

Required qualifications

• 4+ years of experience building data pipelines in production, with at least 2 years on AWS using Python
• Hands-on experience with Microsoft Graph API for SharePoint and Teams, including permissions and throttling
• Experience with unstructured content ingestion into S3 for search or vector indexing
• Familiarity with Amazon Bedrock Knowledge Bases or similar vector ingestion paths
• Infrastructure-as-code experience using Terraform or AWS CDK for pipeline deployment