Senior Data Engineer

Job Summary

To advance data platform capabilities, the remote Senior Data Engineer will design, build, and optimize end-to-end data pipelines and architectures on AWS and Databricks, ensuring the delivery of actionable insights across various data domains.

Key responsibilities

• Design and deliver data solutions on Databricks, including maintaining lakehouses using Delta Lake with medallion architecture
• Translate complex business requirements into technical designs and implement production-grade data solutions within Databricks
• Develop and maintain ETL/ELT pipelines using Apache Spark on Databricks, optimizing for resource efficiency and throughput

Required qualifications

• 5+ years of experience in Data Engineering, focusing on Databricks, AWS services, and data transformation languages such as Python or Scala
• Strong knowledge of modern data architecture principles, including Delta Lake and Unity Catalog governance
• 3+ years of experience working with cloud platforms, primarily AWS, architecting and operating Databricks environments
• Experience with workflow automation and pipeline orchestration using Databricks Workflows or equivalent cloud-native schedulers
• Proficiency in SQL and experience with data modeling constructs like fact and dimension tables