Hadoop Developer

Job Summary

Seeking an experienced Hadoop Developer, the full-time remote position will design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop, focusing on ingesting and analyzing vast volumes of data to support enterprise analytics and machine learning initiatives.

Key Responsibilities

• Design, develop, and operate end-to-end big-data pipelines on Hadoop, integrating data from various sources
• Build robust ETL/ELT workflows using tools like Apache Spark, Hive, and Sqoop, ensuring data quality and recoverability
• Develop high-throughput streaming data pipelines and automate pipeline orchestration using workflow engines

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience designing and operating big-data pipelines on Hadoop
• Strong expertise with Apache Spark in production environments
• Solid experience with Hive, HDFS, and the broader Hadoop ecosystem
• Hands-on experience with streaming data platforms such as Kafka or Spark Streaming