Senior Principal Data Engineer

Job Summary

As the primary architect and strategic lead for the MLOps and forecasting platform, the full-time Senior Principal Data Engineer will design and implement automated data pipelines on the Databricks Data Intelligence Platform, ensuring scalable and high-performance production services for campaign projections and budget forecasting in a remote work environment.

Key responsibilities

• Design and architect a unified MLOps and forecasting platform, leveraging MLflow and Databricks SQL for data processing
• Build and maintain automated pipelines for critical business use cases, including budget utilization monitoring and incrementality testing
• Collaborate with product and business stakeholders to translate business goals into technical roadmaps and mentor senior engineers

Required qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field; PhD preferred
• 10+ years of experience in data engineering with a focus on MLOps pipelines in production
• Expertise in the Databricks Data Intelligence Platform, including Unity Catalog and MLflow
• Proficiency in Python, SQL, and PySpark, with knowledge of data modeling for large-scale analytics
• Strong understanding of time-series forecasting and statistical modeling techniques