Job Summary
A company is looking for a Senior Data Engineer to design, develop, and maintain data processing solutions in an Azure Databricks environment.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Azure Databricks and Scala
- Collaborate with data scientists, analysts, and stakeholders to implement effective solutions
- Perform data analysis, modeling, and transformation to ensure data quality and integrity
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field
- Proven experience working with Azure Databricks for data engineering tasks
- Strong proficiency in Scala programming language
- Solid understanding of data modeling, data warehousing, and ETL concepts
- Experience with .NET development is highly desirable