Big Data Engineer

Job Summary

A company is looking for a Big Data Engineer to lead the development of scalable data solutions in a cloud-native environment.

Key Responsibilities

• Create and maintain programs in Python, Spark, Perl, Shell Scripting, and C for data processing
• Collaborate with cross-functional teams to understand data requirements and ensure data quality and governance
• Mentor junior engineers and drive performance tuning and automation of data workflows

Required Qualifications

• Bachelor's degree or equivalent in computer science
• Minimum 5 years of experience in Python, Perl, and C programming languages
• Good understanding of Spark and pySpark
• Familiarity with databases such as Hive, Postgres, or Oracle
• Experience with scheduling tools such as Airflow or Control-M