Job Summary
A staffing agency needs applicants for an opening for a Remote Senior Software Data Engineer.
Core Responsibilities Include:
- Building end-to-end ETL pipelines to enable training and operationalization of machine learning models
- Building code for ingesting data from relational databases
- Integrating the code, produced by data scientists, into data pipelines
Skills and Requirements Include:
- 2+ years of production data engineering experience using tools like Spark, Hive, or similar
- Strong SQL skills
- Excellent data wrangling skills
- Good understanding of the distributed data processing
- Experience of creating Spark scripts either in Python or Scala
- Experience of setting up and querying Hive, Presto, or Impala databases
