Big Data Lead

Job Summary

A company is looking for a Big Data Lead to oversee a team of Data Engineers.

Key Responsibilities

• Lead the team of Data Engineers in technical design and decision-making
• Manage ETL processes and data warehousing initiatives
• Conduct data analysis and support data migration and production operations

Required Qualifications

• Strong experience in Databricks, Pyspark, and Medallion Architecture
• Proficiency in SQL, including stored procedures, views, and user-defined functions
• Experience with Azure Cloud services, including ADF and Azure Datalake
• Familiarity with SQL Server and data lineage concepts
• Knowledge of additional tools such as Amazon Redshift, Apache Spark, and Snowflake is a plus