Job Summary

Information Technology Platform has an open position for a Remote Higher Education Data Engineer.

Core Responsibilities Include:

• Building large scale, batch data pipelines with Airflow and Spark/Scala for the Higher Education data team
• Working to understand and operationalize business opportunities leveraging our data
• Designing scalable solutions across distributed systems utilizing cutting edge cloud and big data technologies

Qualifications Include:

• 5 years of experience in data engineering, software development, business intelligence, data science, or related fields
• Good exposure in distributed systems, distributed data processing frameworks, data warehouses, technical architectures, infrastructure components, ETL/ELT design patterns
• 2 years of experience with distributed data processing (Hadoop, Spark), working with DataFrames/Datasets API and SparkSQL to query and perform data manipulation
• 2 years of experience with any cloud computing platforms, preferably AWS (Kinesis, S3, Lambda, ECS, Redshift)
• Understanding of software engineering best practices, including coding standards, code reviews, source control management (GitHub), build processes (CI/CD), testing and operations