Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer to join their Utility Data Ingest team, focusing on the resilience, scalability, and performance of data pipelines.

Key Responsibilities

• Design, build, and maintain data pipelines using Databricks and Python
• Develop and manage orchestration workflows using Airflow or similar tools
• Lead improvements for reliability and fault tolerance of ingest pipelines handling high volume utility data

Required Qualifications

• 5 to 8 years of experience in data engineering or backend engineering roles
• Strong working knowledge of Databricks, Spark, or similar distributed data systems
• Experience with Airflow or other workflow orchestration tools in production
• Proficient in Python and SQL, with an understanding of scalable data design
• Familiarity with cloud platforms (GCP or AWS) and cost performance tradeoffs