Lead Data Integration Engineer

Job Summary

To support data integration initiatives, the full-time Lead Data Integration Engineer will collaborate with Technical Architects, Product Owners, and Business teams to translate requirements into technical designs for data modeling and integration, while working remotely from anywhere in the U.S.

Key responsibilities:

• Design and develop ETL/ELT pipelines and reusable frameworks for data processing
• Build efficient SQLs and data ingestion frameworks using tools such as Python, Spark, and Azure Data Factory
• Review functional domain needs to identify gaps and automate pipeline build and testing processes

Required qualifications:

• Bachelor's degree in computer science, applied computer science, IT, or a related field
• 10 years of experience in designing and developing ETL/ELT pipelines and SQLs on MPP platforms
• 5 years of experience with data ingestion frameworks and building data processing jobs
• Experience with various databases including HANA, Snowflake, and NoSQL databases
• Proficiency in data analytics development using Azure and other data processing platforms