Lead Data Engineer

Job Summary

Working remotely in a full-time capacity, the Lead Data Engineer will develop and deploy data engineering platforms and integration solutions, collaborating with teams to implement data solutions using Python and PySpark while maintaining scalable data pipelines across the organization.

Key responsibilities

• Design and implement data structures, workflows, and integrations to ensure accurate business process execution
• Maintain and improve the performance of databases, queries, and data processing systems
• Collaborate with analytics and data science teams to automate data analysis and ensure compliance with data governance standards

Required qualifications

• Minimum graduation degree with 12+ years of related experience, including experience in schema design and data modeling
• Proficiency in Python and PySpark, along with database development experience using ETL processes and SQL
• Experience with data governance and security standards, including working with data quality teams
• Exposure to big data tools such as Databricks, Snowflakes, and Spark
• Familiarity with machine learning and data science concepts