Data Engineer II

Job Summary

To support the autonomy program, the remote full-time Data Engineer II will design, build, and operate data infrastructure, focusing on data ingestion pipelines, dataset curation, and visualization tools for high-bandwidth sensor data.

Key responsibilities

• Contribute to the design and organization of the data lake, including schema definitions and metadata indexing
• Build and maintain end-to-end data pipelines to ingest sensor logs into cloud storage with high reliability
• Deploy and maintain data visualization tools to support log review and autonomy debugging workflows

Required qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field with 4+ years of data engineering experience, or a Master's with 2+ years
• Strong proficiency in Python and SQL, with experience building production-quality data pipelines
• Experience with cloud data infrastructure, preferably AWS, and infrastructure-as-code tools
• Solid understanding of data partitioning strategies and columnar storage formats
• Proven ability to evaluate and integrate open-source tools effectively