Big Data Engineer

Job Summary

To drive the development and optimization of scalable data platforms in the AWS Cloud, the remote Big Data Engineer will design and maintain large-scale data pipelines and API-driven microservices while ensuring high performance and reliability in a long-term contract role.

Key responsibilities

• Design, build, and maintain large-scale batch and real-time data pipelines using Spark, Hadoop, and AWS EMR
• Develop, deploy, and optimize API-based microservices leveraging Java, Scala, and AWS API Gateway
• Implement data ingestion, transformation, and automation workflows with PySpark, Snowflake, and Airflow

Required qualifications

• 7+ years of experience designing, developing, and testing Big Data solutions (batch and APIs)
• Deep hands-on AWS experience, including EMR, EC2, ECS, S3, Step Functions, and API Gateway
• Proficiency in Scala, PySpark, and Java (REST APIs, SOAP web services)
• Strong knowledge of Hadoop, HDFS, Spark, MapReduce, and Cassandra
• Solid Linux administration skills with shell scripting and Python automation