Senior Data Engineer

Job Summary

Working remotely in a full-time capacity, the Senior Data Engineer will design, build, and maintain scalable data pipelines while collaborating with cross-functional teams to enhance AI-native products and optimize complex ETL processes.

Key responsibilities

• Design and maintain scalable data pipelines using Python, Spark, and Airflow for data acquisition and entity resolution
• Collaborate with AI/ML and Product teams to implement new features and products
• Identify and resolve bottlenecks in ETL processes and contribute to code reviews and testing

Required qualifications

• 5+ years of production data engineering experience with ownership of end-to-end systems
• Strong proficiency in Python and experience with a JVM language (Scala preferred)
• Hands-on experience with Snowflake or equivalent in BigQuery/Redshift
• Experience deploying AI or ML applications in production, including monitoring and cost management
• Orchestration experience with Apache Airflow or similar workflow tools