Job Summary
A staffing agency is searching for a person to fill their position for a Remote Staff Data Engineer.
Must be able to:
- Design, develop, and maintain data pipelines to handle large and complex data sets using Big Data technologies
- Ensure that data pipelines are scalable, reliable, and performant
- Help develop sustainable data solutions with current and leading next generation data technologies to transform business capabilities
Applicants must meet the following qualifications:
- Bachelor’s degree or equivalent experience in MIS, Computer Science, Mathematics, Business, or related field
- At least 4 years of Data Engineering experience with Big Data Technologies: Apache Spark, Hadoop, or Kafka
- At least 3 years of programming experience: Python, Java or Scala
- At least 2 years of experience building data pipelines, CICD pipelines, and fit for purpose data stores
- At least 1 year of experience in Cloud technologies: AWS, Azure, Google Cloud, OpenStack, Docker, Ansible, Chef or Terraform
