Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer for their Data Lake Team.

Key Responsibilities

• Support and maintain the data platform using technologies like PySpark, Databricks, and Airflow
• Develop, optimize, and maintain a framework for running over 10,000 data pipelines daily
• Design and implement a Data Quality framework and user-facing services for data ingestion

Required Qualifications

• At least 4 years of experience in data engineering
• Strong programming skills, preferably in Python
• Expertise in big data engineering and web services
• Experience with cloud platforms, ideally AWS
• Willingness to build diverse components and drive platform evolution