QA Automation Engineer

Job Summary

To support quality engineering for the Enterprise Data Platform, the full-time remote QA Automation Engineer will validate data pipelines, enhance data quality frameworks, and execute automated tests using tools like PySpark, Python, and SQL.

Key Responsibilities:

• Execute and extend automated tests within Databricks to validate data pipelines
• Perform data reconciliation between source systems and target datasets
• Implement validation checks for data completeness, accuracy, and quality

Required Qualifications:

• 5+ years of experience in data validation, QA engineering, or SDET roles
• Hands-on experience with creating Databricks notebooks and data pipeline validation
• Strong proficiency in PySpark, Python, SQL, and Databricks notebooks
• Experience working with and extending existing data validation or data quality frameworks
• Experience executing tests within CI/CD pipelines (e.g., Azure DevOps)