Data Software Engineer

Job Summary

To support the development of large-scale Big Data systems, the full-time Data Software Engineer will design, develop, test, and maintain software for data ingestion and processing, utilizing technologies such as SQL, Python, and Spark, with the option to work remotely one or more days per week.

Key responsibilities

• Develop software for extracting, transforming, and loading large data sets in an Agile environment
• Debug functional and performance issues on software modules running on Snowflake, Databricks, and Spark
• Create monitoring dashboards and ensure the availability and scalability of critical software deployments

Required qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field
• Two years of experience in software development using SQL, Presto, Python, Scala, Java, and Spark within AWS
• Experience developing APIs using Go and performing multithreading for data processing applications
• One year of experience processing large amounts of data using Snowflake and Databricks
• Proficiency in using Jenkins for CI/CD and storing relational data in MySQL