Data Engineer II

Job Summary

Designing and optimizing data ingestion pipelines, the full-time salaried Data Engineer II will develop Python-based data processing solutions and provide L3 support while collaborating with cross-functional teams in a remote work environment.

Key responsibilities

• Design, develop, and maintain scalable data ingestion pipelines using StreamSets or similar technologies
• Monitor, troubleshoot, and resolve complex production issues, providing L3 support to ensure system stability
• Collaborate with cross-functional teams to implement automation and follow best practices in data integration

Required qualifications

• Minimum 7 years of experience in software engineering with hands-on experience in StreamSets pipeline management
• Bachelor's degree in computer science, Information Technology, or a related field (or equivalent experience)
• Strong proficiency in Python development for data processing and automation
• Solid understanding of cloud platforms (AWS, Azure, or GCP) and data lake architectures
• Experience with security protocols, including SSL and secure data transfer mechanisms