PySpark Developer

Job Summary

A company is looking for a PySpark & Delta Lake Developer.

Key Responsibilities

• Develop and maintain data pipelines using Python and PySpark
• Implement and manage Delta Lake features, ensuring data integrity and performance
• Utilize AWS cloud services for data processing and storage solutions

Required Qualifications

• Strong proficiency in Python and PySpark
• Advanced experience with Delta Lake and its features
• Solid SQL skills for data manipulation in distributed environments
• Hands-on experience with AWS cloud data services
• Familiarity with data lake concepts and performance tuning