Senior Data Engineer
Job Summary
Seeking a Senior Data Engineer for a fully remote contract position, the candidate will support the modernization of a healthcare pharmacy compliance platform by building ingestion pipelines, implementing transformations, and ensuring data quality using Databricks.
Key responsibilities:
- Build and maintain high-volume ingestion pipelines for Delta Lake architecture
- Implement transformations and re-implement SQL Server logic in PySpark and Spark SQL
- Develop data quality checks and optimize Spark performance while managing compute costs
Required qualifications:
- 6+ years of data engineering experience, with 3+ years in Databricks and Apache Spark
- Strong proficiency in Python, PySpark, and SQL/T-SQL
- Practical experience with Delta Lake, including MERGE operations and incremental loads
- Deep understanding of the Spark execution model and performance troubleshooting
- Experience in building idempotent, re-runnable data pipelines
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 41,175 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
Wikipedia Wikipedia URL
BBB URL BBB URL
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
