Software Engineer II, Big Data

Job Summary

To support a data-driven organization, the full-time salaried Software Engineer II, Big Data will design and implement robust data infrastructure in AWS using Spark with Scala, while collaborating with cross-functional teams to optimize data pipelines and storage solutions.

Key responsibilities

• Design and implement robust data infrastructure in AWS, utilizing Spark with Scala
• Evolve core data pipelines to efficiently scale for significant growth
• Collaborate with cross-functional teams to design data solutions that meet business needs

Required qualifications

• Production data engineering experience with proficiency in Spark and Scala
• Experience in delivering APIs backed by relationship-heavy datasets
• Strong proficiency in AWS services and expertise in SQL for data manipulation
• Bachelor's degree in Computer Science or a related field
• Demonstrated ability to use AI to improve workflow efficiency and quality