Data Engineer

Job Summary

A company is looking for a Data Engineer to join their data team.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Apache Spark
• Build and manage Delta Lake tables and implement data ingestion and transformation processes
• Collaborate with cross-functional teams to translate requirements into technical solutions and ensure data quality and governance

Required Qualifications

• Bachelor's degree in computer science, information technology, engineering, or a related discipline
• Minimum 5+ years of experience as a Data Engineer, with 3-5 years specifically in Azure Databricks
• Proficiency in Python, PySpark, Spark SQL, and experience with large-scale datasets
• Experience with workflow orchestration tools like Databricks Workflows or Airflow
• Familiarity with data governance and quality control best practices