Job Summary
An IT infrastructure services provider is in need of a Telecommute Senior Big Data Developer.
Core Responsibilities of this position include:
- Working efficiently under UNIX/Linux environment
- Working with in-memory computing using R, Python, Spark, PySpark and Scala
- Parsing and shredding XML and JSON, shell scripting, and SQL
Skills and Requirements Include:
- Experience working with SQL (DB2, SQLServer, Sybase, Oracle) and No SQL databases
- Experience with DevOps, CI/CD implementations: Docker or Jenkins or Test Driven Development patterns
- Experience designing and developing data sourcing routines utilizing typical data quality functions
- Knowledge of data, master data and metadata related standards, processes and technology
- Experience working with multi-Terabyte data sets (structured, semi/unstructured data)
- Knowledge of job scheduling and monitoring tools like Oozie and Autosys
