Senior DataOps Engineer

Job Summary

Working remotely in a full-time capacity, the Senior DataOps Engineer will manage data analytics infrastructure, build and maintain CI/CD pipelines, and provision cloud-based Spark clusters while ensuring effective data processing and analytics for healthcare stakeholders.

Key responsibilities:

• Build, maintain, and run CI/CD pipelines and infrastructure-as-code for the platform and associated services
• Provision, configure, and operate cloud-based Spark clusters and distributed data processing environments
• Investigate and resolve data pipeline and integration issues, providing root-cause analysis and durable fixes

Required qualifications:

• 6+ years in a DevOps, DataOps, or data platform engineering role
• Hands-on experience with Apache Spark and at least one managed Spark platform
• Proficiency in Python and solid working knowledge of Java or Scala applications
• Experience with pipeline orchestration tools such as Apache Airflow or similar
• Strong CI/CD experience with GitLab CI, Jenkins, or GitHub Actions