Data Engineer

Job Summary

Working remotely, the full-time Data Engineer will design, build, and maintain scalable data pipelines using Python, Spark, and Airflow, while collaborating with cross-functional teams to develop AI-native products and optimize complex ETL processes.

Key responsibilities

• Design and maintain scalable data pipelines to support data acquisition and entity resolution engines
• Collaborate with AI/ML and Product teams to implement new features and products
• Identify and resolve bottlenecks in ETL processes, contributing to code optimization and engineering culture

Required qualifications

• Professional proficiency in Python and experience with Git for shared codebases
• Experience with relational databases such as PostgreSQL or BigQuery, and familiarity with graph databases
• Familiarity with distributed computing frameworks like Spark
• Strong collaborative skills in an Agile, sprint-based environment
• Self-directed with the ability to complete tasks autonomously and communicate effectively