Data Engineer II

Job Summary

A company is looking for a Data Engineer II to focus on building systems, pipelines, and infrastructure for data usability.

Key Responsibilities

• Build and maintain PySpark data pipelines in the Databricks environment while optimizing performance and resource usage
• Design, develop, and maintain backend software components and services ensuring functionality and scalability
• Create and maintain comprehensive technical documentation and perform thorough code reviews

Required Qualifications

• 5+ years of related experience with a bachelor's degree in computer science, computer engineering, or a related field
• Strong technical skills including Python, Apache Spark, and a solid understanding of software design patterns and distributed computing
• Experience building data pipelines (ETL/ELT) and managing databases with SQL performance
• Experience working with cloud platforms such as AWS, Azure, or GCP
• Technical skills in SQL, Python/Scala, ETL pipelines, and data modeling