Big Data Engineer

Job Summary

A company is looking for a Big Data Engineer.

Key Responsibilities

• Develop and test end-to-end ETL pipelines
• Utilize Databricks, Unity Catalogue, and Medallion Architecture for data management
• Perform data analysis and support data migration and production operations

Required Qualifications

• Strong experience with ETL processes and data warehousing
• Proficiency in Databricks, Pyspark, and SQL
• Experience with Azure Cloud services, including ADF and Azure Datalake
• Familiarity with SQL Server and data lineage concepts
• Knowledge of additional tools such as Amazon Redshift and Apache Spark is a plus