Big Data Engineer

Job Summary

A company is looking for a Big Data Lead.

Key Responsibilities

• Implement ETL pipelines and data transformation processes
• Troubleshoot and resolve issues related to PySpark applications and workflows
• Ensure compliance with data security and privacy regulations

Required Qualifications

• 4+ years of experience in big data development, including Hadoop, Hive, and Spark
• Strong programming skills in Python and SQL
• Experience with big data technologies like Kafka
• Knowledge of data warehousing concepts and relational databases
• Certification in big data or cloud technologies is preferred