Staff Data Engineer

Job Summary

A company is looking for a Staff Data Engineer.

Key Responsibilities:

• Develop data pipelines for ingesting large amounts of diverse data from various sources
• Evolve data architecture and support both current pipelines and legacy systems
• Collaborate with stakeholders to leverage company data for improved search and recommendations

Required Qualifications:

• BS or MS in Computer Science (or related field) with 10+ years of experience in large-scale data processing pipelines
• Proficiency in Apache Spark, Scala, and PySpark with 2-4 years of experience in production-grade batch pipelines
• At least 4+ years of experience in Java and API/Microservices
• 2+ years of experience in Python and complex SQL for ETL processes
• Knowledge of big data technologies and experience with AWS services