Data Engineer II, Virginia Licensed

Job Summary

A company is looking for a Data Engineer II, PySpark/Databricks.

Key Responsibilities:

• Build and maintain PySpark data pipelines in the Databricks environment
• Optimize Spark jobs performance and resource usage, addressing bottlenecks in backend systems
• Design, develop, and maintain high-quality backend software components and services

Required Qualifications:

• Bachelor's degree and 8 years of experience
• Strong experience with Python / Apache Spark
• Solid understanding of data modeling, ETL processes, and distributed computing
• Experience with Agile development methodologies
• Strong understanding of software design patterns, data structures, and algorithms