Data Engineer

Job Summary

A company is looking for a Data Engineer to design and develop data platforms.

Key Responsibilities

• Own the data warehouse, data pipelines, and integration points between business systems
• Design, develop, and support batch and real-time data pipelines, recommending improvements
• Manage data models to enable AI/ML data products and implement process improvements across the data platform

Required Qualifications

• 3-5 years of experience with data warehouse/data lake and ETL architectures, cloud data warehouses, Python, and SQL
• At least 2 years of experience with Airflow and Spark
• Experience in developing scalable, real-time data pipelines using Python/Scala, SQL, and distributed processing frameworks
• Exposure to AWS platform and services such as EKS, MSK, and MWAA
• Experience building data features using Snowflake, dbt, and Python for AI/ML inference