Data Engineer - AI

Job Summary

To enhance data management and integration processes, the full-time remote Data Engineer - AI will create and execute Spark and SQL scripts, optimize queries, and collaborate with cross-functional teams to ensure data quality and compliance in the healthcare sector.

Key responsibilities

• Create, maintain, and execute intermediate to advanced Spark and SQL scripts for data management and validation
• Optimize queries for improved efficiency and perform data analysis to identify issues
• Collaborate with engineering, DBA, and cloud operations teams to troubleshoot and resolve environmental or network issues

Required qualifications

• Bachelor's degree in Computer Science, Information Technology, or equivalent experience
• 3+ years of experience with big data technologies (Spark, S3, Kafka, etc.) and cloud technologies (Databricks, AWS, Azure)
• 3+ years of experience with RDBMS and proficiency in SQL or ETL tools
• Experience in data analysis, preferably within the healthcare industry
• Familiarity with data pipeline orchestration tools and project management tools like JIRA