Job Summary
An IT consulting and staffing company is seeking a Telecommute Senior Data Engineer.
Candidates will be responsible for the following:
- Expand and optimize data and the data pipeline architecture
- Optimize data flow and collection for cross functional teams
- Support software developers, database architects, and data analysts on data initiatives
Applicants must meet the following qualifications:
- Bachelor's Degree or master’s degree in Computer Science, Mathematics, Statistic
- 4+ years of development experience in using Spark to build applications through Python and PySpark
- 3+ years’ hands-on experience developing optimized, complex SQL queries and writing PLSQL code
- Experience in deploying and developing application using Azure
- Experience working with disparate data-sets in multiple formats like JSON, Avro, text files, and Kafka queues
- 2+ years of strong ETL experience on Informatica, Ab-Initio, Talend, DataStage, or Syncsort