Data Engineer

Job Summary

A company is looking for a Data Engineer to join their remote team.

Key Responsibilities

• Migrate the current reporting infrastructure to a new data platform
• Set up data export pipelines for clients and implement data streams for ML workflows
• Establish pipeline monitoring and alerting systems, and manage ingestion pipelines

Required Qualifications

• Experience in Python for data processing tasks
• Proficiency with Git, CI/CD systems, and cloud platforms
• Expertise in pipeline orchestration frameworks like Airflow or Dagster
• Strong proficiency in SQL for complex queries and data manipulation
• Experience with Docker, Kubernetes, and Helm charts is highly desirable