Job Summary
A software developer is searching for a person to fill their position for a Remote Senior Analytics Data Engineer.
Must be able to:
- Orchestrate data workflows to automate, schedule and monitor data pipelines with tools like Airflow
- Partner with stakeholder teams to ingest and process raw datasets for downstream analysts/data scientists
- Troubleshoot data quality issues and resolve broken data pipelines
Must meet the following requirements for consideration:
- Are an expert in SQL, Python and PySpark
- Are an expert with building, maintaining and optimizing scalable data pipelines
- Are knowledgeable of cloud data technologies like Snowflake and Databricks
- Have proven experience building data pipelines with orchestration tools such as AirFlow or Luigi
- Have outstanding written and verbal communication skills
- Have experience querying and doing transformations on large structured/unstructured datasets in SQL/Hive, Spark, Apache Flink etc