Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer to build scalable data pipelines and optimize big data solutions.

Key Responsibilities

• Build infrastructure and automate data pipelines for ingestion, processing, and loading of data
• Collaborate with stakeholders to develop data products and ensure alignment with organizational goals
• Create tests to monitor technical performance and develop data analysis tools for insights

Required Qualifications

• 7+ years of development experience in data engineering within a production environment
• Proven experience with large datasets exceeding 100M+ records or multiple terabytes
• 2+ years of experience in scalable, distributed systems using AWS
• 5+ years of programming experience with Python and experience in big data ecosystems, specifically Spark
• Bachelor's degree in Computer Science, Information Systems, Mathematics, or a related field