Senior Data QA Engineer
Job Summary
Leading the quality strategy for big data platforms, the full-time remote Senior Data QA Automation Engineer will design and implement automated testing frameworks within Databricks Lakehouse architecture, ensuring high-quality data validation and mentoring junior engineers on best practices.
Key Responsibilities
- Architect, build, and scale automated test frameworks in Databricks using PySpark, Python, and SQL
- Design automated assertions for Delta Lake tables, focusing on data drift, schema evolution, and historical data validation
- Lead the integration of automated data quality tests into enterprise CI/CD pipelines, utilizing tools like Azure DevOps and GitHub Actions
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related quantitative field
- 8+ years of experience in data engineering, data QA, or software development engineering in test (SDET), with 2+ years in Databricks test automation
- Mastery of Python and PySpark for processing and profiling large datasets
- Deep expertise in advanced SQL queries and Spark query execution plans
- Hands-on experience with big-data validation libraries such as Great Expectations and pytest
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 41,590 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
