Lead Data Engineer

Job Summary

A company is looking for a Lead Data Engineer (Python/Databricks).

Key Responsibilities

• Interview and hire Data Engineers, supervising their work and assisting with complex tasks
• Develop and maintain scalable data pipelines using Databricks for batch and streaming use cases
• Collaborate with cross-functional teams to provide reliable data sets for analytics and machine learning

Required Qualifications

• 5+ years of experience in data engineering or big data development
• Proficiency in architecting and developing scalable data solutions on the Databricks platform
• Experience in designing and maintaining production-grade data pipelines using Python (or Scala) and SQL
• Familiarity with data governance and security policies, utilizing tools like Unity Catalog
• Upper-Intermediate English level