Senior Databricks Engineer

Job Summary

Owning the ingestion layer for a Databricks lakehouse project, the full-time Senior Databricks Engineer will manage source discovery, design ingestion patterns, and build pipelines while working remotely.

Key responsibilities

• Run source discovery and document data structures, extraction constraints, and integration topology
• Design and implement ingestion patterns for various data sources, ensuring robust data handling and quality checks
• Model and reconcile bill-of-materials data across multiple systems, managing schema evolution and operating batch patterns

Required qualifications

• 7+ years of production data engineering experience on Databricks, with proficiency in Python, PySpark, and SQL
• Hands-on experience with Lakeflow Connect or equivalent managed change data capture ingestion
• Direct experience building JDBC-based ingestion against Oracle E-Business Suite
• Experience with SQL Server as an ingestion source and familiarity with PLM and MBSE systems
• Databricks Data Engineer Professional certification