Senior Data Engineer with Public Trust Clearance

Job Summary

To support data engineering initiatives, the full-time Senior Data Engineer with Public Trust Clearance will design, implement, and maintain data architecture and pipelines in a remote environment, ensuring efficient data processing and quality control.

Key responsibilities

• Provide expertise on data engineering methods and best practices, focusing on modern pipeline design and code first development
• Design and maintain ELT and ETL pipelines for processing data in Azure Synapse and Azure Machine Learning
• Establish quality controls and documentation for data pipelines, ensuring robust operational procedures and error handling

Required qualifications

• Bachelor's degree in data engineering, computer science, data science, machine learning, mathematics, or a related field, or five years of relevant work experience
• 5 years of experience maintaining SQL databases and conducting advanced operations in SQL and T-SQL
• 5 years of experience designing and implementing ELT and ETL processes in cloud-based data analytics environments
• 3 years of experience working with Azure Synapse and Azure Machine Learning; certifications preferred, DP-203 or equivalent
• 3 years of experience manipulating data in Python, with proficiency in Pandas; experience with PySpark and Polars preferred