Data Infrastructure Engineer - AI ML

Job Summary

A company is looking for a Data Infrastructure Engineer - AI/ML.

Key Responsibilities:

• Dive into datasets and design, implement, and scale data pre/post-processing pipelines
• Work on applied ML solutions in query processing, data mining, cleaning, normalizing, and modeling
• Design and build data platforms & frameworks for processing high volumes of data in real-time and batch

Required Qualifications:

• Experience using big data technologies (Airflow, Spark, pySpark, Presto, Athena)
• AWS experience
• Demonstrated prior experience in creating data pipelines for text data sets NLP/ large language models
• Experience building and maintaining ETL pipelines
• Previous experience in building data pipelines for conversational AI APIs