Hadoop Developer

Job Summary

Seeking a skilled Hadoop Developer for a full-time remote position, responsible for designing, building, and operating large-scale data processing pipelines and analytics platforms on Hadoop, while ensuring data quality and performance optimization.

Key Responsibilities

• Design and develop end-to-end big-data pipelines on Hadoop, ingesting data from various sources
• Build robust ETL/ELT workflows using Apache Spark, Hive, and other tools, focusing on data quality and error handling
• Optimize Spark and MapReduce jobs to meet performance SLAs while minimizing costs

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience designing and operating big-data pipelines on Hadoop
• Strong expertise with Apache Spark in production environments
• Solid experience with Hive, HDFS, Sqoop, and the broader Hadoop ecosystem
• Hands-on experience with streaming data platforms such as Kafka or Spark Streaming