Data Engineer - AI

Job Summary

To support data operations, the full-time Data Engineer - AI will create and manage Spark and SQL scripts for data validation and integration, optimize queries, and collaborate with cross-functional teams in a remote environment.

Key responsibilities

• Create and execute Spark and SQL scripts for data management and validation
• Optimize queries to enhance task efficiency and perform data analysis to identify issues
• Collaborate with engineering and cloud operations teams to troubleshoot and resolve data-related issues

Required qualifications

• Bachelor's degree in Computer Science, Information Technology, or equivalent experience
• 3+ years of experience with big data technologies (e.g., Spark, Hadoop) and cloud platforms (e.g., AWS, Azure, GCP)
• 3+ years of experience with RDBMS and proficiency in SQL or ETL tools
• Familiarity with data pipeline orchestration tools (e.g., Airflow, Databricks Workflows)
• Experience in data analysis, preferably in the healthcare industry