Data Automation Engineer

Job Summary

To support data automation initiatives, the contract GenAI Data Automation Engineer will design and maintain data pipelines using AWS services, develop ETL processes, and leverage Generative AI frameworks while working remotely.

Key responsibilities

• Design and maintain data pipelines in AWS, integrating various data sources for analytics and operational reporting
• Engineer ingestion pipelines with Apache Spark and Kafka for real-time and batch processing
• Implement CI/CD best practices for data pipelines and GenAI model integration while ensuring security and compliance

Required qualifications

• BS in Computer Science or related field with 2+ years of data engineering and automation experience
• Hands-on experience with SQL, Python, Spark, and AWS services like S3 and RDS/SQL Server
• Familiarity with Apache Flume, Kafka, and Generative AI frameworks such as AWS Bedrock and Azure OpenAI
• Experience with integrating REST API calls in workflows and using tools like JIRA and GitHub for CI/CD automation
• Ability to obtain Federal government Public Trust clearance