Job Summary
Adata science and consulting firm is filling a position for a Remote Lead Data Engineer.
Core Responsibilities Include:
- Leading the design of and develop Cloud and Hadoop based solutions
- Participating in implementation of BI visualizations, unit and integration testing
- Driving improvements in people, practices, and procedures
Position Requirements Include:
- 5+ years proven ability of professional data development experience
- 3+ years proven ability of developing with Hadoop/HDFS
- 3+ years developing experience with either Java or Python
- 3+ years experience with PySpark/Spark
- 3+ years experience with Airflow
- Full understanding of ETL concepts