Lead Data Engineer
Job Summary
Hands-on and experienced, the full-time Lead Data Engineer will design and build scalable data pipelines using Azure Databricks, Spark, and PySpark, while optimizing performance and collaborating with cross-functional teams in a hybrid work environment.
Key responsibilities
- Design and build scalable data pipelines using Azure Databricks, Spark, and PySpark
- Lead end-to-end data engineering solutions from design through production
- Establish coding standards and best practices while mentoring engineering teams
Required qualifications
- 13+ years of total experience in the data warehousing space
- Strong hands-on experience with Azure Databricks (5+ years required)
- Deep expertise in Spark/PySpark, Python, and SQL
- Experience building large-scale ETL/ELT data pipelines
- Knowledge of Delta Lake, ADLS, ADF, Unity Catalog, CI/CD, and Azure DevOps is a plus
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 38,620 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
Wikipedia Wikipedia URL
BBB URL BBB URL
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
