Hadoop Developer

Job Summary

Hadoop Developer, seeking an experienced professional to design and operate large-scale data processing pipelines in a full-time, remote position.

Key Responsibilities

• Design, develop, and operate end-to-end big-data pipelines on Hadoop, ingesting data from various sources
• Build robust ETL/ELT workflows using Apache Spark, Hive, and other tools, ensuring data quality and error handling
• Optimize Spark and MapReduce jobs and implement data governance and monitoring strategies for big-data pipelines

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of professional experience designing and operating big-data pipelines on Hadoop
• Strong hands-on expertise with Apache Spark in production environments
• Solid experience with Hive, HDFS, Sqoop, and the broader Hadoop ecosystem
• Experience with workflow orchestration tools such as Airflow or Oozie