Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer.

Key Responsibilities

• Design and build highly reliable and scalable data pipelines using PySpark and big data technologies
• Collaborate with the data science team to develop new features that enhance model accuracy and performance
• Create standardized data models to improve consistency across various deployments

Required Qualifications

• 4+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL
• Proficiency in Python for data processing and automation
• Knowledge of PySpark, distributed computing, and analytical databases
• Expertise in designing and managing ETL pipelines and distributed data processing frameworks
• Hands-on experience with workflow orchestration tools such as Apache Airflow