Data Engineer

Job Summary

A company is looking for a Data Engineer II to build and maintain data systems and pipelines in a remote environment.

Key Responsibilities

• Build and maintain PySpark data pipelines in the Databricks environment, optimizing performance and resource usage
• Design, develop, and maintain high-quality backend software components and services
• Create and maintain comprehensive technical documentation and perform thorough code reviews

Qualifications

• 5+ years of related experience and a bachelor's degree in computer science, computer engineering, or a related field
• Strong technical skills including Python, Apache Spark, R, and SAS
• Experience building data pipelines (ETL/ELT) and managing databases with SQL
• Experience working with cloud platforms (AWS/AZURE/GCP)
• Familiarity with Databricks/Spark, dbt, and airflow