Data Engineer

Job Summary

A company is looking for a Data Engineer.

Key Responsibilities

• Build infrastructure for data ingestion, transformation, and loading using Spark, SQL, AWS, and Databricks
• Develop an entity resolution framework to merge individual entities into clean datasets
• Create CI/CD pipelines and anomaly detection systems to enhance data quality in production

Required Qualifications

• 4-6+ years of industry experience in technical problem-solving and implementation
• Strong software development fundamentals and experience with Python
• Expertise in Apache Spark and SQL
• Experience with cloud computing services (AWS preferred) and data warehousing solutions
• Knowledge of modern data design and storage patterns