Director of Data Engineering

Job Summary

Leading a team of data engineers, the full-time remote Director of Data Engineering will build and scale data infrastructure using Databricks and Spark, while setting strategic direction and ensuring alignment with business leaders.

Key responsibilities

• Lead the development of large-scale, real-time data pipelines in Spark
• Act as the primary technical liaison to business leadership, translating technology and business priorities
• Set the multi-year technical direction for Data Engineering and communicate strategy across technical and business audiences

Required qualifications

• 8-10 years of data or software engineering experience, including 5+ years managing engineering teams
• Deep hands-on experience building large-scale Spark applications for batch and streaming workloads
• Expertise with modern lakehouse platforms (Databricks or similar) and traditional Spark-based pipelines
• Strong programming background in Python and/or Scala, with SQL fluency across large-scale datasets
• Experience with AWS data services (Kinesis, S3, Lambda, DynamoDB) and distributed systems