Senior Big Data Engineer

Job Summary

To support the Tech Enablement team, the full-time Senior Big Data Engineer will design, build, and maintain data pipelines and systems for web events, tackle challenges with large datasets, and develop frameworks to accelerate machine learning across products in a hybrid work environment.

Key responsibilities

• Design, build, deploy, and maintain data pipelines and systems for web events and event streams
• Utilize batch and streaming techniques to process large, evolving datasets efficiently and reliably
• Develop frameworks and systems to enhance ML development velocity, quality, and observability

Required qualifications

• 4+ years of professional software development experience, particularly with data pipelines for customer-facing products
• Hands-on experience with Apache Spark, including writing and debugging batch and/or streaming jobs
• Experience deploying and operating containerized services and batch jobs
• Solid understanding of computer science fundamentals, including data structures and distributed systems
• Experience with AWS services such as S3, IAM, and EC2