Staff Software Engineer Python

Job Summary

A company is looking for a Staff Software Engineer (Python) to own the data infrastructure for real-time pricing decisions in the hospitality industry.

Key Responsibilities

• Design and maintain the data lakehouse architecture, improving the Python/PySpark pipeline framework
• Architect and implement the transition from batch processing to near-real-time streaming data pipelines
• Enhance data quality and governance while optimizing performance and reliability of data processing systems

Required Qualifications

• 7+ years of experience building production data systems in Python
• Expertise in PySpark and distributed data processing using Glue, EMR, or Databricks
• Experience with lakehouse architectures such as Iceberg, Delta Lake, or Hudi on S3
• Production experience with workflow orchestrators like Airflow
• Solid AWS experience across services such as S3, Glue, Athena, Lambda, and SQS