Data Engineer II

Job Summary

Working remotely in a full-time capacity, the Data Engineer II will design and optimize scalable data pipelines and workflows, implement advanced data processing techniques, and ensure data quality and governance while collaborating with cross-functional teams.

Key responsibilities:

• Designs and optimizes scalable and robust data pipelines to handle large datasets
• Implements advanced data processing and scheduling techniques using frameworks like Apache Spark, ADF, and Airflow
• Ensures data quality, governance, and security through automated testing and monitoring solutions

Required qualifications:

• Bachelor's degree in computer science, data analytics, statistics, or a related field
• 2-5 years of experience in data engineering or a related role
• Proficiency in SQL and experience with database management systems
• Strong programming skills in languages such as Python, Java, or Scala
• Experience with orchestration tools like Apache Airflow or AWS Glue for data ingestion and delivery