Senior Software Engineer

Job Summary

Joining a rapidly growing ML Platform team, the full-time Senior Software Engineer will build and operate the ML data, tooling, serving, and inference layers to enhance Attentive's AI product suite while working remotely.

Key responsibilities

• Unlock offline and real-time access to extensive data points for ML and Data Science teams
• Manage, expand, and optimize the feature store for feature engineering and multi-TB scale training jobs
• Support PB scale data operations using Apache Spark, Spark Structured Streaming, Kafka, and Ray

Required qualifications

• 5+ years of experience in Data Engineering / MLOps with a focus on PB-scale feature stores
• Proficiency in Apache Spark, Spark Streaming, and Ray for building data pipelines
• Understanding of data cardinality, query plans, and their impact on pipeline performance
• Experience in creating infrastructure for training ML models and fine-tuning LLMs
• Knowledge of online and offline ML inferences and their critical business elements