Senior Databricks Engineer

Job Summary

A company is looking for a Senior Consultant (Databricks Engineer) with expertise in Databricks tools and a background in the Healthcare domain.

Key Responsibilities

• Design and develop scalable data pipelines using Databricks tools and frameworks
• Ingest and process healthcare data products while ensuring compliance with data standards such as HL7, CCDA, and FHIR
• Continuously monitor and optimize pipeline performance and provide guidance to junior engineers

Required Qualifications

• 5+ years of experience in data engineering, with 3+ years of hands-on experience with Databricks
• Proven experience in the healthcare domain and knowledge of healthcare data standards (HL7, CCDA, FHIR)
• Strong knowledge of Delta Lake and expertise in PySpark, Scala, or Python
• Bachelor's degree in Computer Science, Information Systems, or equivalent experience
• Experience designing and implementing ETL/ELT workflows in cloud environments (Azure or AWS)