Senior Data Engineer

Job Summary

To support a growing engineering team, the full-time Senior Data Engineer will design and implement data architecture, build and maintain data collection systems, and ensure data quality and security in a remote work environment.

Key responsibilities

• Design and implement scalable data architecture using tools like Metaflow and Spark
• Collaborate with researchers to understand data needs and develop appropriate solutions
• Take ownership of data engineering projects, ensuring high-quality data solutions and infrastructure stability

Required qualifications

• 5+ years of relevant experience in data engineering
• Expertise in designing distributed data pipelines with big data technologies
• Solid experience with AWS services such as Amazon EMR and AWS Batch
• Hands-on experience with containerization technologies like Docker and Kubernetes
• Familiarity with various database technologies, including SQL and NoSQL databases