Senior Data Engineer

Job Summary

To enhance data analysis efficiency, the remote Senior Data Engineer will design and maintain data pipelines using SparkSQL and Pyspark, transforming IoT device data into actionable insights for analytics and model training.

Key responsibilities

• Build and maintain reliable computed tables incorporating diverse data sources, including unstructured data
• Integrate external datasets with internal data to ensure high-quality data delivery
• Collaborate with cross-functional teams to support various data needs, including statistical analysis and dashboarding

Required qualifications

• BA/MS degree in Computer Science, Statistics, or a related discipline
• 4+ years of experience in a data engineering-focused role
• Proficiency in building ETL pipelines to handle large volumes of data
• Experience with Spark-based data platforms and data orchestration tools
• Strong command of SQL and Python, with familiarity in working with REST APIs