Data Engineer II

Job Summary

A company is looking for a Data Engineer II to join a remote team focused on building systems and data pipelines for analysts and data scientists.

Key Responsibilities

• Build and maintain PySpark data pipelines in the Databricks environment while optimizing performance and resource usage
• Design, develop, and maintain high-quality backend software components and services
• Create and maintain comprehensive technical documentation and perform thorough code reviews

Qualifications

• 5+ years of related experience with a bachelor's degree in computer science, computer engineering, or a related field
• Strong technical skills in Python, Apache Spark, R, SAS, and a solid understanding of software design patterns and data structures
• Experience in building data pipelines (ETL/ELT) and managing databases with SQL performance
• Experience working with cloud platforms such as AWS, Azure, or GCP
• Familiarity with Databricks, Spark, dbt, and airflow