Senior Data Engineer

Job Summary

To support data-driven decision-making across various business functions, the remote contract Senior Data Engineer will build and maintain scalable data pipelines and datasets while collaborating with cross-functional teams.

Key responsibilities

• Develop and maintain scalable data pipelines and reusable datasets within a Databricks lakehouse environment
• Ingest, validate, clean, and transform structured and unstructured data from multiple sources using Python, PySpark, and SQL
• Improve pipeline reliability, data quality, and processing performance while implementing automated testing and CI/CD practices

Required qualifications

• 7+ years of experience in data engineering, including building and supporting production data pipelines
• Strong SQL skills and a solid understanding of data modeling, database design, and data warehousing
• Hands-on experience with Databricks, Apache Spark, and cloud data platforms
• Proficiency in Python and PySpark, with experience in developing ETL/ELT pipelines
• Familiarity with source control, automated testing, and CI/CD practices