Job Summary
A healthcare company is in need of a Remote Senior Data Engineer.
Must be able to:
- Work with terabytes of healthcare data, developing a petabytes-scale data platform
- Design data structures that are optimized against process and data skew when dealing with large data sets
- Optimize data architecture for consumption, utilization, and analytics
Applicants must meet the following qualifications:
- 5+ plus years with big data technologies, such as Apache Hadoop, Databricks, Snowflake
- 3+ plus years of job-related experience in programming languages such as Scala, Python, or similar
- 3+ years of experience, building production data pipelines
- 3+ year of experience using Spark
- 3+ years with private and public cloud deployment
- 1+ year building microservices architecture using containerization technologies like docker, packer or Kubernetes