Job Summary
A software development company is in need of a Remote Spark Senior Data Engineer .
Candidates will be responsible for the following:
- Transforming structured, semi-structured, and unstructured data for use by BI/ML/AI processes
- Writing comprehensive unit and integration tests for all data processing
- Collaborating with DevOps/BI/AI/ML/Product Teams
Position Requirements Include:
- Competent with Scala, Spark, and the Spark Dataframe/Dataset API
- Ability to communicate effectively in writing, in person, over the telephone and in e-mail
- Bachelors degree
- Competent in basic SQL
- Big Data mindset and experience