Senior Data Engineer

Job Summary

Transforming raw external data into actionable datasets, the remote Senior Data Engineer will design and implement robust production-grade pipelines using Python, Spark SQL, and Airflow while collaborating with cross-functional teams to ensure data accuracy and reliability.

Key responsibilities

• Design and implement production-grade data pipelines to process high-volume datasets
• Lead efforts to standardize raw healthcare data into internal models and integrate new customer data
• Monitor pipeline health and proactively resolve production data flow issues

Required qualifications

• 6+ years of experience as a Data Engineer with a focus on building production-grade pipelines
• Strong expertise in Python, Spark SQL, and Airflow
• Experience processing large-scale file-based datasets in production environments
• Familiarity with AWS and experience onboarding new customers with non-standard data formats
• Ability to work across teams and manage complex data workflows with minimal supervision