Hadoop Developer

Job Summary

Hadoop Developer, an experienced professional is sought for a full-time remote position to design, build, and operate large-scale data processing pipelines and analytics platforms using Hadoop and related technologies.

Key Responsibilities

• Design and develop end-to-end big-data pipelines on Hadoop, ingesting data from various sources
• Build robust ETL/ELT workflows and optimize Spark and MapReduce jobs for performance and cost-efficiency
• Collaborate with data scientists to deliver reliable datasets and automate pipeline orchestration

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience in designing and operating big-data pipelines on Hadoop
• Strong expertise in Apache Spark (Scala, Python, or Java) and the broader Hadoop ecosystem
• Experience with streaming data platforms like Kafka and workflow orchestration tools such as Airflow
• Solid understanding of distributed systems concepts and strong scripting skills in Python or Shell