Senior Serverless Spark Engineer
Job Summary
Leading the migration of production Apache Spark workloads from on-premise environments to cloud-native architectures, the fully remote Senior Serverless Spark Migration Engineer will assess applications, design modern solutions, and optimize performance across AWS and GCP.
Key responsibilities
- Lead migrations of enterprise Spark workloads to AWS and GCP, determining the appropriate migration approach
- Modernize traditional cluster-based workloads for serverless Spark and refactor legacy applications for cloud portability
- Build reusable migration tooling and implement CI/CD and Infrastructure as Code practices
Required qualifications
- 8+ years of experience in data engineering, distributed systems, cloud engineering, or platform engineering
- 5+ years of hands-on experience with Apache Spark in enterprise environments
- Strong development experience in PySpark and/or Scala
- Proven experience migrating large-scale Spark workloads between infrastructure platforms
- Hands-on experience with both AWS and GCP cloud services
Complete Job Description
The complete job description is available to members. Premium membership includes:
Full access to 42,033 remote jobs from human-vetted companies, updated daily
Resume Builder - AI-powered tool to craft, enhance, and tailor your resume to a specific job
Twice-monthly live group coaching and the full Remote Career Center
20% member discount on Career Services
Backed by a 30-day money-back guarantee
Company Company Name
Headquarters Headquarters
Founded Founded
Website
The company description is available to members. Go Premium for full access to every job and company profile in our remote jobs database, backed by a 30-day money-back guarantee.
