Big Data Lead

Job Summary

Designing and implementing data ingestion and data lake solutions, the full-time Big Data Lead will leverage Big Data technologies to create efficient data pipelines and support analytics and data science teams while working remotely.

Key responsibilities

• Design and implement data ingestion and data lake solutions using Big Data technologies
• Develop cost-efficient and performant data pipelines in a cloud environment
• Monitor and optimize performance of data processes to enhance query execution speed

Required qualifications

• Proficiency in Big Data and open-source technologies
• Experience with data integration and manipulation techniques
• Knowledge of various data pipeline techniques and frameworks
• Experience in data mining and using data ingestion APIs
• Ability to discover patterns in data sets for effective data management