Senior Data Engineering Analyst

Job Summary

To advance data management initiatives, the full-time Senior Data Engineering Analyst will develop and maintain scalable data pipelines in PySpark, migrate legacy processes to distributed models, and implement data processing solutions in AWS, all while working remotely.

Key responsibilities

• Develop and maintain scalable and efficient data pipelines using PySpark
• Migrate and modernize legacy processes to new distributed processing models
• Implement data processing solutions in an AWS environment

Required qualifications

• Bachelor's degree in a relevant field
• Solid experience with PySpark and distributed processing frameworks
• Knowledge of Apache Airflow, Spark, and Hadoop (where applicable)
• Proficiency in programming languages, preferably Python
• Experience with relevant AWS services (e.g., EMR, Lambda, DynamoDB, S3, Glue optional)