Hadoop Developer

Job Summary

Seeking an experienced Hadoop Developer, the full-time remote position will design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop, focusing on ingesting and analyzing massive volumes of data to support enterprise analytics and machine learning.

Key Responsibilities

• Design and develop end-to-end big-data pipelines on Hadoop, integrating data from various sources
• Build robust ETL/ELT workflows using Apache Spark, Hive, and other tools, ensuring data quality and error handling
• Optimize Spark and MapReduce jobs for performance and cost-effectiveness while maintaining data governance and quality controls

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience in designing and operating big-data pipelines on Hadoop
• Strong expertise in Apache Spark (Scala, Python, or Java) in production environments
• Experience with Hive, HDFS, Sqoop, HBase, and streaming data platforms such as Kafka
• Proficient in SQL and familiar with workflow orchestration tools like Airflow or Oozie