Data Engineer

Job Summary

As the first dedicated Data Engineer in a full-time remote position, the successful candidate will manage data ingestion pipelines, ensure data trustworthiness, and collaborate with the Head of Engineering to design and implement a reliable data architecture for public procurement processes.

Key responsibilities

• Develop and maintain data ingestion pipelines for supplier, agency, and contract data from various sources
• Establish a canonical data model to ensure consistent records across all entities and definitions
• Implement testing, lineage, and freshness protocols to enhance data reliability and accessibility for internal teams

Required qualifications

• Data engineering experience in a startup or scale-up environment
• Proficiency in SQL and Python, with a strong understanding of data modeling
• Experience working with messy external data sources, including APIs and flat files
• Knowledge of entity resolution or record linkage techniques
• Familiarity with AI tools and their application in data engineering processes