Senior Data Engineer

Job Summary

A company is looking for a Senior Platform Data Engineer.

Key Responsibilities

• Stream and curate clinical data for AI model consumption in Databricks
• Design and manage document ingestion and retrieval pipelines for clinical data
• Administer Databricks platform and ensure data quality for retrieval-augmented generation

Required Qualifications

• 5+ years of experience in data engineering with batch and streaming pipelines
• Expertise in Databricks, including Delta Live Tables and PySpark
• Hands-on experience with real-time data ingestion frameworks
• Strong SQL and Python skills for data transformation and feature engineering
• Bachelor's degree in a related field; Master's degree preferred