Senior Data Pipeline Engineer

Job Summary

A company is looking for a Senior Data Pipeline Engineer to own and evolve the data infrastructure that powers its core data products.

Key Responsibilities

• Own and operate the data platform infrastructure, managing AWS services and Databricks administration
• Maintain and improve data pipeline reliability, monitoring and resolving pipeline failures
• Build and extend data ingestion pipelines for new operational data sources

Qualifications

• 8+ years of experience in data engineering or data platform roles
• Experience with Databricks administration and lakehouse architecture
• Proficient in Apache Airflow administration and DAG development
• Deep hands-on expertise in AWS services (EC2, RDS, VPC, S3)
• Experience managing Terraform in production environments