Databricks Data Engineer
Get new jobs like this one by email. Create a free account for job alerts and to save the jobs you like.
Job Summary
Hands-on and detail-driven, the full-time Databricks Data Engineer will design, build, and operate scalable lakehouse solutions remotely, transforming multi-source data into reliable enterprise data products while collaborating with data scientists and analysts to enable advanced analytics for the VA's ATLAS platform.
Key Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and Apache Spark
- Build and manage Delta Lake tables using the medallion architecture to deliver analytics-ready data
- Implement data governance and security best practices while integrating data from various source systems
Required Qualifications
- Experience with Databricks, Apache Spark, PySpark, and Spark SQL
- Proficiency in building Delta Lake tables and managing data pipelines
- Familiarity with Spark Structured Streaming and messaging platforms like Kafka
- Knowledge of data governance practices and Unity Catalog for access control
- Experience integrating data with CI/CD pipelines and enterprise SDLC tooling
Complete Job Description
The complete job description is available to premium members. Premium membership includes:
Full access to 39,452 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to premium members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
