Hadoop Developer

Job Summary

To support a growing team, the full-time remote Hadoop Developer will design, build, and operate large-scale data processing pipelines, focusing on ingesting and analyzing massive volumes of data to enhance enterprise analytics and reporting workloads.

Key Responsibilities

• Design and develop end-to-end big-data pipelines on Hadoop, integrating data from various sources
• Build robust ETL/ELT workflows using Apache Spark, Hive, and other tools, ensuring data quality and recoverability
• Optimize performance of Spark and MapReduce jobs to meet service level agreements while minimizing costs

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience designing and operating big-data pipelines on Hadoop
• Strong expertise with Apache Spark in production environments
• Hands-on experience with Hive, HDFS, and the broader Hadoop ecosystem
• Experience with workflow orchestration tools such as Airflow or Oozie