Job description
About the Role
This is a fully hands-on, individual contributor Data Engineering role embedded within a data infrastructure initiative at a large enterprise. You will own the full lifecycle of AWS-based data pipelines, from ingesting and streaming source data through to delivering clean, consumer-ready datasets for downstream use.
What You'll Do
Stream and process source data from mainframe and legacy systems, loading it into AWS S3.
Design and implement ETL/ELT workflows using AWS Glue.
Perform data reconciliation, validation, and quality checks to ensure data accuracy and reliability.
Curate and transform data, provisioning clean datasets through AWS Aurora and RDS (PostgreSQL).
Manage S3 storage including data retention policies, archival strategies, and lifecycle management.
Automate workflows and manage deployments using GitHub and GitHub Actions-based CI/CD pipelines.
Leverage AI tools to improve engineering productivity and automate data workflows.
What We're Looking For
5 or more years of professional Data Engineering experience building and delivering data pipelines, ETL/ELT workflows, or data platform solutions.
Hands-on production experience with AWS Glue for designing and implementing ETL/ELT workflows.
Strong working knowledge of AWS cloud services including S3, RDS/Aurora, and Glue.
Demonstrated experience building and maintaining data streaming pipelines using Kafka.
Experience implementing data reconciliation, data quality checks, and validation processes.
Proficiency with GitHub repository management and GitHub Actions for CI/CD automation.
Experience using AI tools to automate workflows and improve productivity.
Ability to take ownership of deliverables and drive work to completion with minimal oversight.
Experience with mainframe data sources or legacy system integration is a plus.
Familiarity with MongoDB or other NoSQL databases is a plus.
Compensation & Benefits
This role pays $65/hr on a W2 basis.
Location
This role is 100% remote.
Originally posted on Himalayas
Who can apply
The source lists worldwide eligibility. Accepted UTC offsets: UTC-11, UTC-10, UTC-9.5, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC-4, UTC-3.5, UTC-3, UTC-2, UTC-1, UTC+0, UTC+1, UTC+2, UTC+3, UTC+3.5, UTC+4, UTC+4.5, UTC+5, UTC+5.5, UTC+5.75, UTC+6, UTC+6.5, UTC+7, UTC+8, UTC+8.75, UTC+9, UTC+9.5, UTC+10, UTC+10.5, UTC+11, UTC+12, UTC+12.75, UTC+13, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.