Lead Data Engineer - Texas

Job Summary

A company is looking for a Lead Data Engineer - Azure Databricks Lakehouse.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Spark
• Build and orchestrate workflows with Azure Data Factory and manage data storage with Azure Data Lake Storage
• Develop CI/CD pipelines using Azure DevOps and optimize SQL code across various platforms

Required Qualifications

• 8-12 years of experience in data engineering
• Proficiency in Azure Cloud Platform and Azure Data Factory
• Strong hands-on experience with Databricks, Spark, and PowerShell scripting
• Advanced SQL skills, including T-SQL and PostgreSQL
• Familiarity with data formats such as Parquet and Delta Lake