Data Engineer - AI/BI

Job Summary

Data Engineer - AI/BI, a full-time remote position focused on designing and operating Databricks-based Data & AI capabilities, including building scalable ELT pipelines and ensuring data quality for analytics and machine learning.

Key Responsibilities

• Build and scale Databricks AI/BI solutions, including dashboards and ETL/ELT pipelines following Medallion Architecture
• Integrate data from enterprise systems and implement standardized data ingestion processes with automated error handling
• Develop data quality checks and monitoring tools to ensure data integrity and compliance with security standards

Required Qualifications

• Hands-on experience with Databricks (Delta Lake, Apache Spark) and AI/BI solution development
• Deep understanding of ELT pipeline development and orchestration in cloud environments
• Experience with Medallion Architecture and data versioning in enterprise settings
• Proficiency in SQL, Python, or Scala for data transformations
• Experience integrating enterprise platforms into centralized data solutions