GCP Cloud Engineer

Job Summary

To enhance data ingestion pipelines, the remote GCP Cloud Engineer with Java will manage Airflow DAGs, optimize Composer performance, and maintain GCP infrastructure, including services like BigQuery and Cloud Functions, on a contract basis.

Key responsibilities

• Fix and enhance Dataflow and Dataproc data ingestion pipelines
• Monitor and optimize GCP Composer performance and manage Airflow-related issues
• Design and implement infrastructure as code using Terraform for GCP resource management

Required qualifications

• Proficient in Java or Python programming languages
• Strong understanding of GCP Composer (Apache Airflow) and related environments
• Experience with database design and RDBMS-PLSQL knowledge
• Familiarity with CI/CD pipelines and tools like Jenkins
• Knowledge of IAM, service account permissions, and cloud security best practices