Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer - Quantitative Data Pipelines.

Key Responsibilities

• Design, develop, and maintain efficient ETL/ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow
• Transform and prepare data for quantitative analysis and machine learning applications
• Implement data quality checks and validation processes to ensure accuracy of financial data

Required Qualifications

• 7+ years of experience as a Data Engineer, with at least 2 years focusing on the Databricks ecosystem
• Strong proficiency in Python, including data science libraries like Pandas
• Proven experience with AWS cloud services and data architecture
• Experience with DBT for data transformation and documentation
• Familiarity with Apache Airflow for workflow orchestration