Data Engineer

Job Summary

A company is looking for a Data Engineer responsible for building and maintaining data infrastructure.

Key Responsibilities

• Develop data pipelines using Databricks to integrate data into the data lake
• Design and implement large-scale distributed systems focused on scalability and fault-tolerance
• Manage data processing and transformation using technologies such as Apache Spark and SQL

Required Qualifications

• BS/BA in Computer Science, Data Science, or a related field or relevant experience
• 2+ years of experience in data engineering solutions using PySpark in Databricks
• Knowledge of relational databases and Apache Spark
• Strong understanding of Databricks configuration and performance tuning
• Experience with CI/CD development tools and programming languages for data processes (PySpark, Python, Scala)