Data Pipeline Engineer

Job Summary

A company is looking for a Data Pipeline Engineer to manage and evolve its data infrastructure.

Key Responsibilities

• Own and operate the data platform infrastructure, including AWS services and Databricks administration
• Maintain and improve data pipeline reliability, monitoring and resolving failures
• Build and extend data ingestion pipelines for new operational data sources

Qualifications

• 4+ years of experience in data engineering or data platform roles
• Experience with Databricks administration and lakehouse architecture
• Proficiency in Apache Airflow administration and DAG development
• Deep hands-on expertise in AWS services (EC2, RDS, VPC, S3)
• Experience managing Terraform for infrastructure as code