Lead Data Engineer

Job Summary

A company is looking for a Lead Data Engineer (Databricks) to drive data platform modernization initiatives.

Key Responsibilities

• Lead end-to-end Databricks migration initiatives from legacy platforms to modern cloud-based architectures
• Design and implement scalable data architecture frameworks in Azure environments
• Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, PySpark, and SQL

Required Qualifications

• 10+ years of experience in Data Engineering
• Strong hands-on experience with Databricks, SQL, Azure Data Factory, DataStage, Python, and PySpark
• Experience designing enterprise-level data architecture solutions
• Strong knowledge of cloud data platforms, preferably Azure
• Experience with data modeling and large-scale data processing