Data Engineer

Job Summary

A company is looking for a Data Engineer, Analytics Data Engineering.

Key Responsibilities

• Define company data assets and create Spark, SparkSQL, and HiveSQL jobs
• Design data integrations and data quality frameworks while evaluating tools for data lineage
• Collaborate with teams to develop a long-term Data Platform architecture and optimize data pipelines and visualizations

Required Qualifications

• 5+ years of experience in Spark, Python, Java, C++, or Scala development
• 5+ years of SQL experience
• 5+ years of experience with schema design, dimensional data modeling, and medallion architectures
• Experience with the Databricks platform and data lake architectures
• BS degree in Computer Science or a related technical field, or equivalent technical experience