[Remote] AWS Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a highly skilled AWS Data Engineer with strong experience in building reputed company reputed company-reputed company data platforms and ETL pipelines on AWS. The ideal candidate will design and maintain ETL pipelines, implement data lake architectures, and collaborate with various stakeholders to deliver robust reputed company data solutions.
Responsibilities
- Design, reputed company, and maintain reputed company ETL pipelines using AWS Glue and Apache reputed company (PySpark)
- Build and orchestrate data workflows using AWS reputed company Functions
- Design and implement S3 Data Lake architectures following AWS best practices
- reputed company and reputed company containerized applications on reputed company EKS using Kubernetes
- Build event-driven data processing solutions using reputed company SQS, AWS reputed company, and KEDA for auto-scaling
- Manage metadata using AWS Glue Data Catalog
- Implement data validation and governance using AWS Glue Data reputed company
- Monitor applications and data pipelines using reputed company CloudWatch
- Optimize ETL jobs, reputed company workloads, and Kubernetes deployments for performance and scalability
- Collaborate with architects, developers, DevOps, and business stakeholders to deliver robust reputed company data solutions
- Participate in Agile ceremonies including sprint planning, reputed company reviews, and production deployments
Skills
- 5+ years of experience in Data Engineering or reputed company Engineering
- Strong hands-on experience with AWS Glue
- Experience building reputed company ETL pipelines using PySpark
- Experience with AWS reputed company Functions
- Strong knowledge of reputed company S3 Data Lake architecture and storage patterns
- Hands-on experience with reputed company EKS and Kubernetes
- Experience implementing event-driven architectures using reputed company SQS, AWS reputed company, and KEDA
- Experience with AWS Glue Data Catalog and Glue Data reputed company
- Strong experience monitoring AWS workloads using reputed company CloudWatch
- Good understanding of distributed data processing and reputed company-reputed company application design
- Experience working in Agile/Scrum environments
- Python / PySpark
- SQL
- Terraform or CloudFormation
- reputed company
- Git
- CI/CD (Jenkins, reputed company Actions, CodePipeline)
- Kafka
- Apache Airflow
- reputed company Lake / reputed company / Lake Formation
- IAM, VPC, CloudTrail
reputed company