Data Engineer

Job Summary

A company is looking for a Data Engineer to enable efficient data access and support machine learning processes.

Key Responsibilities

• Enable efficient data access by creating and maintaining data pipelines
• Collaborate with ML engineers to design and maintain automation for machine learning processes
• Build data infrastructure for analytics, hypothesis testing, and company metrics

Required Qualifications

• 3+ years of experience in data engineering or a similar role
• Extensive experience with Apache Spark using Python for large-scale data processing
• Familiarity with Databricks or similar cloud data platforms is advantageous
• Experience with AWS, Azure, or other Kubernetes platforms is a plus
• Hands-on expertise with Git for version control and collaboration