Databricks Data Engineer

Job Summary

Working remotely on a contract basis, the Databricks Data Engineer will develop and support data pipelines in Azure environments, translate business requirements into data engineering solutions, and maintain ETL operations to ensure data quality.

Key responsibilities

• Develop and optimize scalable data solutions using Databricks and Medallion Architecture
• Manage ingestion routines for processing multi-terabyte datasets and integrate data from various sources
• Implement data management strategies to ensure data integrity, availability, and accessibility

Required qualifications

• BS degree in Computer Science or related field; 3+ years of experience or Master's degree with 2+ years of experience
• Databricks Data Engineer certification and 2+ years of experience in maintaining Databricks platform and developing in Spark
• Proficient in Python, Spark, and R; .NET experience is a plus
• Knowledge of data governance, metadata management, and data quality
• Experience with Agile, CI/CD automation, and cloud development (Azure, AWS)