Data Engineer I

Job Summary

A company is looking for a Data Engineer I to build and support scalable data pipelines in a cloud-based environment.

Key Responsibilities

• Create and maintain processes to acquire, validate, and enrich data from various sources
• Support the migration of on-premise data systems to a cloud-based lakehouse architecture
• Develop and optimize ETL/ELT pipelines using PySpark and Spark SQL

Required Qualifications

• 1+ years of work experience in a data engineering role
• Bachelor's degree or greater in a quantitative field or equivalent practical experience
• Hands-on experience with Databricks (Spark, PySpark, Delta Lake) and/or migrating RDBMS systems to a data lakehouse
• Experience with common types of healthcare data from various sources
• Hands-on experience with SQL and Python (including PySpark) for distributed data processing