Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer to design, develop, and optimize data infrastructure and pipelines.

Key Responsibilities

• Design, build, and maintain ETL/ELT pipelines using Azure Data Factory and Databricks
• Develop and optimize data models in various storage solutions, including Azure Data Explorer and No-SQL databases
• Tune and improve the performance of data pipelines and storage solutions for optimal data retrieval and processing speeds

Qualifications and Experience

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
• Minimum 10+ years of professional experience with Python, Azure, and data processing technologies
• Extensive experience in building and managing data pipelines with Azure Data Factory
• Proven experience with Azure Data Explorer and No-SQL databases
• Hands-on experience with Databricks and preparing data for Power BI