Senior Data Engineer

Job Summary

A company is looking for a Senior Data / ML Engineer (PySpark / Databricks / Healthcare Claims).

Key Responsibilities

• Design, build, and maintain scalable data pipelines using PySpark, SQL, and Databricks
• Implement and enhance medallion architecture for structured data delivery
• Optimize Spark jobs for performance, reliability, and cost efficiency

Required Qualifications

• Strong hands-on experience with PySpark, SQL, and Databricks
• Deep understanding of medallion architecture and modern data lakehouse patterns
• Experience implementing data quality frameworks and automated validation
• Proficiency in Spark optimization techniques
• Familiarity with CI/CD, version control, and DevOps practices for data engineering