Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer to design and scale data pipelines for machine-generated data.

Key Responsibilities

• Build and scale distributed data pipelines for large-scale time series and log data
• Design reliable, high-performance Spark/Python workflows for model training datasets
• Analyze and resolve performance bottlenecks and improve data quality for ML workloads

Required Qualifications

• 5+ years of software engineering experience
• Hands-on experience with Apache Spark (PySpark or Scala)
• Experience building large-scale data pipelines in distributed environments
• Strong proficiency in Python
• Experience working with time series, logs, or high-volume event data