Lead Databricks Engineer

Job Summary

A company is looking for a Lead Databricks Engineer to design, build, and scale their cloud-based lakehouse platform.

Key Responsibilities

• Architect and implement an enterprise lakehouse on Databricks across major cloud platforms
• Design scalable batch and streaming data pipelines and establish ingestion patterns from various sources
• Mentor data engineers and lead architecture and code reviews while engaging with stakeholders to align business needs with the data platform roadmap

Required Qualifications

• 8+ years of data engineering experience, with 4+ years on Databricks
• Deep expertise in Apache Spark, including performance tuning and partitioning strategies
• Strong hands-on experience with Delta Lake, Unity Catalog, and Databricks Workflows
• Production experience on at least one major cloud platform (AWS, Azure, or GCP)
• Proficiency in Python and SQL, with a comfort level in Scala being a plus