Lead Data Engineer

Job Summary

A company is looking for a Lead Data Engineer.

Key Responsibilities

• Understand, profile, and assess the quality of raw data from diverse client sources
• Design, build, test, and maintain scalable and robust data pipelines for ingestion, transformation, and enrichment
• Lead discussions with client stakeholders on data architecture, integration, and delivery strategies

Required Qualifications

• BSc, MSc, or PhD in computer science, software engineering, or a related technical field
• Expertise in distributed data processing frameworks (e.g., Spark, Hadoop)
• Strong coding skills in Python, Go, or Scala, with proficiency in Python
• Experience with workflow orchestration tools (e.g., Airflow, Dagster, Prefect)
• Familiarity with cloud environments (AWS, GCP, or Azure) and infrastructure-as-code tools