Data Architect - Databricks Migration
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Job Summary
To support a modernization program, the full-time Data Architect - Databricks Migration will guide the design and migration of production data workloads from legacy systems to Databricks on Azure, collaborating with client teams in a fully remote environment.
Key responsibilities
- Guide the overall solution design for the Databricks platform and align on evolving project priorities
- Lead the migration of production pipelines from Dataiku and Cloudera/Hadoop to Databricks, ensuring stable outputs during the transition
- Support the design and evaluation of real-time event ingestion into Databricks while mentoring client engineers on best practices
Required qualifications
- 7+ years of experience as a Data Engineer, including roles as a technical lead or data architect
- Production experience with Databricks on Azure and strong hands-on skills in Python, PySpark, and advanced SQL
- Proven experience in designing and implementing medallion architectures in production environments
- Experience migrating workloads from Dataiku or Hadoop platforms while maintaining output stability
- Familiarity with streaming or event-driven ingestion on Azure, including Event Hubs and Spark Structured Streaming
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 36,373 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
