Principal Data Engineer

Job Summary

Owning the technical strategy and architecture, the full-time Principal Data Engineer will lead the development and maintenance of a scalable Databricks-based data platform, ensuring data governance and operational excellence in a hybrid work environment.

Key responsibilities

• Own the vision, architecture, and roadmap for the data platform, leading technology decisions and ensuring operational excellence
• Design and maintain scalable streaming and batch data platforms using Databricks, including CI/CD workflows for automated deployments
• Implement data governance and security measures to ensure compliance with HIPAA and SOC 2 standards

Required qualifications

• Bachelor's, Master's, or Ph.D. in Computer Science or a related field, or equivalent professional experience
• 8+ years of data engineering experience with progressive responsibility
• 5+ years of hands-on experience with the Databricks platform
• Expert proficiency in PySpark and Python, with working knowledge of Scala
• Strong experience with Terraform for infrastructure-as-code and CI/CD pipelines for data platform deployments