Job Summary
A software development company needs applicants for an opening for a Remote Data Engineer.
Candidates will be responsible for the following:
- Designing and developing flexible data transformation processes
- Writing and maintaining automated tests for data pipelines
- Monitoring and maintaining health of our data lake clusters in Databricks
Skills and Requirements Include:
- 5 or more years of general software development experience
- Developed production-grade data streaming pipelines with Spark and Kafka
- Experience in a fast-paced venture-backed startup SaaS environment
- Strong understanding of software patterns and data structures
- Experience with observability tooling for big data processes
- Advanced knowledge of SQL as well as Python or Skala