Data Architect - Databricks Migration
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Job Summary
To support a modernization program, the full-time Data Architect - Databricks Migration will guide the migration of production data workloads from legacy systems to Databricks on Azure, collaborating closely with client teams while working remotely during U.S. Eastern time zone business hours.
Key responsibilities
- Guide the overall solution design and define Databricks patterns for the migration project
- Lead the migration of production pipelines from Dataiku and Cloudera/Hadoop to Databricks, ensuring stability throughout the transition
- Work hands-on across workstreams to unblock engineers and mentor client teams in Databricks practices
Required qualifications
- 7+ years of experience as a Data Engineer, including technical lead or data architect roles
- Production experience with Databricks on Azure
- Strong hands-on experience with Python, PySpark, and advanced SQL
- Proven experience designing and implementing medallion architectures in production
- Experience with streaming or event-driven ingestion on Azure, such as Event Hubs or Event Grid
Complete Job Description
The complete job description is available to premium members. Premium membership includes:
Full access to 36,607 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee