Databricks Pipeline Engineer

Job Summary

A company is looking for a Databricks Pipeline Engineer to support the design, implementation, and operation of Databricks in a government enterprise environment.

Key Responsibilities

• Lead data engineering efforts within Databricks, focusing on pipeline development on AWS
• Unify organizational data capabilities and standardize data migration to a unified data warehouse
• Integrate Databricks with existing analytics platforms and serve as a technical advisor to stakeholders

Required Qualifications

• Must be a US Citizen
• Minimum 7 years of experience with Databricks and AWS in a government setting
• Strong understanding of Apache Spark, Lakehouse architectures, and Delta Lake
• Experience with AWS Cloud Native data and ETL capabilities
• Strong Python skills and experience in Agile environments