Data Engineer

Job Summary

A company is looking for a Data Engineer with experience in large-scale data processing systems.

Key Responsibilities

• Design, develop, and deploy large-scale data processing pipelines using technologies like Dataflow and Apache Beam
• Manage data lineage and ensure data security with appropriate tools and methodologies
• Collaborate with stakeholders to translate business problems into effective technical solutions

Required Qualifications

• 2 - 4 years of experience in data engineering, particularly in designing and developing data pipelines
• Proven expertise with technologies such as Dataflow, Apache Beam, and Spark
• Experience with data storage technologies including Bigtable/HBase and BigQuery
• Ability to design data schemas based on domain understanding
• BSc degree in Computer Science, Engineering, or a related field, or equivalent work experience