Job Summary
A software development company has an open position for a Remote Spark and Scala Senior Data Engineer in Tampa.
Individual must be able to fulfill the following responsibilities:
- Build scalable data processing pipelines in Spark
- Write comprehensive unit and integration tests for all data processing
- Collaborate with DevOps/BI/AI/ML/Product Teams
Qualifications for this position include:
- Competent with Scala, Spark, and the Spark Dataframe/Dataset API
- ELT/ETL Best Practices
- Big Data mindset and experience
- Competent in basic SQL
- Linux Shell/GNU skills
- Ability to investigate and research new technologies