Data Engineer

Job Summary

A company is looking for a Data Engineer to join their engineering team focused on data processing systems.

Key Responsibilities

• Contribute production quality code and unit-tests to the Data Collection Hub
• Improve test and build pipelines while supporting data processing pipelines as needed
• Model data effectively for specific business needs and stay updated on Data Engineering developments

Required Qualifications

• At least 2 years of experience working with moderately complex software systems in production
• Fluency in at least one programming language
• Experience with Python (specifically pyspark) and Node.js for data processing
• Familiarity with Hadoop stack technologies such as HDFS and HBase
• Experience with MongoDB, Elasticsearch, Airflow, and Nifi is beneficial