Senior Data Engineer

Job Summary

To support data-driven initiatives, the full-time remote Senior Data Engineer will design, build, and operate production data pipelines using Python and SQL on Databricks, ensuring data quality and governance while collaborating with cross-functional teams.

Key Responsibilities

• Design, develop, and maintain production data pipelines on Databricks, implementing ingestion and transformation processes
• Create and manage Gold-layer data products, ensuring data is trustworthy and aligned with consumer query patterns
• Implement data quality measures and orchestrate data workflows using tools like Dagster, ensuring observability and performance optimization

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field; equivalent practical experience considered
• 3+ years of experience building and supporting production data pipelines in a cloud data platform environment
• Strong hands-on experience with Python and SQL, as well as Databricks or a comparable Spark-based lakehouse
• Practical understanding of medallion architecture and experience with data ingestion from various sources
• Familiarity with orchestration tools like Dagster, Azure Data Factory, or similar for scheduling and monitoring data workflows