Senior Data Engineer

Job Summary

To enhance product eventing and analytics capabilities, the remote Senior Data Engineer will design scalable data solutions, collaborate with cross-functional teams, and ensure data quality across learning interactions and insights.

Key responsibilities

• Define and create meaningful learning events, establishing standards and building reliable event pipelines
• Design and optimize ETL/ELT pipelines using Apache Spark and Databricks, ensuring efficient data transformations
• Maintain end-to-end data quality across event schemas and pipelines, implementing monitoring and validation processes

Required qualifications

• 5+ years of experience in Data Engineering with expertise in Databricks and Delta Lake
• Proficiency in Python (PySpark), Scala, or SQL for data transformation and pipeline development
• Experience with AWS services such as S3, Redshift, and Glue integrated with Databricks
• 1+ years of experience in workflow automation using Databricks Workflows or similar orchestration tools
• Strong understanding of event-driven architectures and data quality principles