Senior Big Data Engineer

Job Summary

A company is looking for a Senior Big Data Engineer who can design, implement, and maintain scalable data processing pipelines.

Key Responsibilities

• Design and develop large-scale data pipelines and infrastructure for high-volume datasets
• Build and maintain scalable ETL/ELT workflows using Apache Spark, Scala, and SQL
• Collaborate with analysts and product stakeholders to deliver data-driven solutions

Required Qualifications

• Strong programming experience with Scala and Apache Spark
• Proficiency in SQL and experience with large datasets in HDFS environments
• Working knowledge of Python for scripting and data manipulation
• Hands-on experience with Docker and/or Kubernetes
• Familiarity with advanced Scala functional programming libraries like Cats and fs2