Job Summary
A rotational savings and credit building app company has a current position open for a Remote Data Infrastructure Engineer.
Individual must be able to fulfill the following responsibilities:
- Own design, development & maintenance of ongoing metrics, reports, analyses & dashboards to inform key business decisions
- Build ETL processes for processing large amounts of financial data for our rent reporting and analytics services
- Build supporting infrastructure to facilitate machine learning workloads including data formatting and correctness validation
Must meet the following requirements for consideration:
- Deep Experience with data processing pipelines
- Experienced in using data processing technologies such as: Apache Spark, Beam, Airflow, SQS/SNS, Apache Kafka, and/or RabbitMQ
- Experience with both SQL and NoSQL databases - including horizontal scaling and query optimization
- Strong programming skills - we primarily use Go and Python
- Familiarity integrating data pipelines with common monitoring systems - such as Grafana, Prometheus, Datadog, etc
