Data Engineer

Job Summary

A company is looking for a Data Engineer to support custom data platforms and manage data ingestion and transformation pipelines.

Key Responsibilities

• Build and maintain data ingestion pipelines using Azure Data Factory and develop data transformation logic in Databricks
• Assist in migrating SQL Server-based processes to Azure native pipelines and continuously enhance existing database solutions
• Collaborate with various teams to ensure data reliability, performance, and quality while managing multiple concurrent initiatives

Required Qualifications

• Hands-on experience building pipelines in Azure Data Factory
• Experience developing data transformations in Databricks, preferably using SQL
• Familiarity with Azure Data Lake Storage or similar cloud storage platforms
• Experience with SQL Server, including complex SQL scripts and stored procedures
• Experience using Git/Azure DevOps for source control