Data Engineer
Job Summary
Supporting and improving large-scale data pipelines and infrastructure, the full-time remote Data Engineer will manage data collection, processing, transformation, validation, and delivery, focusing on scalability, reliability, and performance.
Key responsibilities
- Maintain, optimize, and troubleshoot database queries and related data systems for efficient data access and processing
- Assist in creating and improving data pipelines for large-scale datasets
- Support web scraping initiatives by developing and maintaining scripts to gather publicly available data
Required qualifications
- Bachelor's degree or equivalent work experience
- Advanced proficiency in Python, including async programming and multiprocessing
- Hands-on experience with large-scale web scraping and platform APIs
- Experience designing and operating distributed data pipelines using task queues
- Practical experience with data warehousing solutions like Databend, ClickHouse, or BigQuery
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 40,222 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
