Data Engineer

Job Summary

To support data-driven decision-making, the remote Data Engineer will design, implement, and maintain data systems and infrastructure, focusing on developing data pipelines, optimizing Azure resources, and managing DevOps for Analytics Teams.

Key responsibilities

• Design and develop scalable data systems in collaboration with stakeholders to meet department needs
• Develop and maintain data pipelines for extracting, transforming, and loading data into a centralized data lakehouse
• Manage Azure DevOps releases and pipelines, ensuring smooth deployment processes and performance optimization

Required qualifications

• Proficiency in SQL and Python for data manipulation and automation tasks
• Experience with Azure Function Apps and Azure Synapse Analytics
• Knowledge of data processing frameworks, such as Apache Spark
• Understanding of data management and data governance best practices
• Experience with CI/CD automation for data pipelines using Azure DevOps or GitHub Actions