Data Engineer

Job Summary

A company is looking for a Middle Data Engineer.

Key Responsibilities

• Developing and maintaining data transformation pipelines
• Data collecting from various sources and building a centralized data catalog
• Designing and implementing REST-based APIs

Required Qualifications

• Hands-on experience with storage formats like Parquet, ORC, AVRO, JSON, CSV, TSV
• Experience with distributed computation technologies such as HDFS, Spark, and Apache Flink
• Familiarity with relational databases and columnar storages like PostgreSQL and AWS Redshift
• Knowledge of ETL processes and data warehousing tasks
• Experience with cloud providers such as AWS and Google Cloud Platform