Senior Data Engineer

Job Summary

To support the autonomy program, the remote Senior Data Engineer will design, build, and operate data infrastructure, including ingestion pipelines and data lakes, while collaborating with cross-functional teams to ensure high-quality data for model training.

Key responsibilities

• Own the design and organization of the program's data lake and ingestion pipelines, ensuring high reliability and data integrity
• Build tooling for dataset curation and implement metrics for data quality and model performance
• Deploy data visualization tools to support log review and collaborate with engineers to define data contracts and standards

Required qualifications

• Bachelor's degree in a relevant field with 6+ years of data engineering experience or a Master's with 4+ years
• Strong proficiency in Python and SQL, with experience in building production-quality data pipelines
• Deep experience with cloud data infrastructure, preferably AWS, and infrastructure-as-code tools
• Solid understanding of data partitioning strategies and columnar storage formats
• Proven ability to evaluate and integrate open-source tooling effectively