Azure Databricks Data Engineer

Job Summary

To support the migration of Oracle ETL processes, the full-time Azure Databricks Data Engineer will design, develop, and maintain scalable data pipelines on Microsoft Azure while working remotely for a temporary duration of 5 months.

Key responsibilities

• Analyze existing Oracle SQL and PL/SQL ETL processes and migrate them to Databricks using Spark SQL and/or PySpark
• Design, develop, test, deploy, and maintain scalable data pipelines on Microsoft Azure Databricks
• Validate migrated data with business users to ensure accuracy and completeness during migration

Required qualifications

• Bachelor's degree in computer science, Information Systems, Engineering, or related field
• 4-6 years of experience in ETL, database development, or data engineering
• 4+ years of advanced SQL development and query optimization
• 3+ years of Oracle PL/SQL development
• 3+ years of experience developing data pipelines using Databricks on Microsoft Azure