Data Engineer II

Job Summary

A company is looking for a Data Engineer II to provide transformative solutions to clients' big data challenges in a remote setting.

Key Responsibilities

• Build and maintain PySpark data pipelines within the Databricks environment, optimizing performance and resolving inefficiencies
• Design, develop, and support backend software components and services to ensure functionality and scalability
• Create and maintain technical documentation while conducting research and developing proof of concept solutions

Required Qualifications

• 5+ years of related experience
• Solid understanding of R and data modeling, ETL processes, and distributed computing
• Strong experience with Python and Apache Spark
• Bachelor's degree in computer science, computer engineering, or a related field
• Must be able to obtain a Public Trust clearance