Big Data Lead

Job Summary

A company is looking for a Big Data Lead to manage a team of Data Engineers and make technical design decisions.

Key Responsibilities

• Lead a team of Data Engineers in hands-on technical design and decision-making
• Oversee ETL processes and data warehousing activities
• Perform data analysis and manage data migration and production support

Required Qualifications

• Strong experience with Databricks, Pyspark, and Medallion Architecture
• Proficient in SQL, including stored procedures, views, and user-defined functions
• Experience with Azure Cloud services, including ADF and Azure Data Lake
• Familiarity with SQL Server and data lineage concepts
• Experience with data analysis techniques