Hadoop Developer

Job Summary

Experienced in building data processing solutions, the full-time remote Hadoop Developer will design, develop, and operate large-scale data pipelines using Hadoop and related technologies to support enterprise analytics and machine learning initiatives.

Key Responsibilities

• Design and implement end-to-end big-data pipelines on Hadoop, ingesting data from various sources
• Build ETL/ELT workflows using Apache Spark, Hive, Pig, and Sqoop, ensuring data quality and recoverability
• Develop and optimize high-throughput streaming data pipelines with Kafka and Spark Streaming, integrating them with analytical systems

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience designing and operating big-data pipelines on Hadoop
• Strong hands-on expertise with Apache Spark in production environments
• Solid experience with Hive, HDFS, Sqoop, and the broader Hadoop ecosystem
• Hands-on experience with streaming data platforms such as Kafka or Spark Streaming