Hadoop Developer

Job Summary

To support a growing team, the full-time Hadoop Developer will design, build, and operate large-scale data processing pipelines and analytics platforms remotely, focusing on ingesting, transforming, and analyzing massive volumes of data.

Key Responsibilities

• Design and develop end-to-end big-data pipelines on Hadoop, integrating data from various sources
• Build robust ETL/ELT workflows using Apache Spark, Hive, and other tools, ensuring data quality and error handling
• Optimize Spark and MapReduce jobs for performance and cost-effectiveness while maintaining data governance and monitoring strategies

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of professional experience with Hadoop and big-data pipeline design
• Strong hands-on expertise with Apache Spark in production environments
• Experience with Hive, HDFS, Sqoop, and streaming data platforms like Kafka
• Solid SQL skills and familiarity with workflow orchestration tools such as Airflow