Databricks Data Engineer

Job Summary

Seeking a hands-on Databricks Data Engineer, the full-time remote position will design, build, and operate scalable data and analytics solutions on the Databricks Lakehouse platform to support federal mission needs.

Key Responsibilities

• Design, develop, and maintain scalable batch and streaming data pipelines using Databricks, Apache Spark, PySpark, and Spark SQL
• Build and manage Delta Lake tables using the medallion architecture to deliver reliable, analytics-ready data
• Implement data governance, access controls, and security best practices using Unity Catalog

Required Qualifications

• Strong practical experience with Apache Spark, Delta Lake, and Unity Catalog
• Solid understanding of modern data architecture patterns, including medallion architecture and structured streaming
• Experience with real-time data ingestion solutions using Spark Structured Streaming and messaging platforms like Kafka
• Familiarity with CI/CD pipelines and enterprise SDLC tooling, including Git-based version control
• Ability to collaborate effectively with data scientists and analysts to support machine learning and AI use cases