Senior Data Engineer

Job Summary

Serving as the primary technical owner, the contract Senior Data Engineer will maintain and enhance Nebraska's enterprise data processing framework for Medicaid Encounter Processing, utilizing technologies such as Scala, Apache Spark, and Cloudera Data Platform, while working remotely in the CST time zone.

Key responsibilities

• Own the Scala/Spark application framework and implement business rules using Drools
• Manage enterprise data ingestion processes and oversee production issue resolution
• Perform application performance tuning and maintain technical documentation

Required qualifications

• Minimum 7 years of experience in developing enterprise-scale distributed data processing applications
• Strong hands-on development experience with Scala and Apache Spark
• Experience with Cloudera Data Platform (CDP) and Apache Hive for data processing
• Proficient in SQL development and query optimization
• Experience supporting Linux-based production environments