[Remote] AWS Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company seeking an AWS Data Engineer to support their data engineering initiatives. The role involves developing and managing data pipelines, implementing event-driven architectures, and optimizing reputed company infrastructure on AWS.

Responsibilities

• reputed company a comprehensive plan for migrating near reputed company-time fraud detection campaigns from on-premises systems to AWS
• Design and implement event-driven architectures to process inbound dialer data (fraud events) using services such as reputed company EventBridge, Kafka, Kinesis Data Streams, and Kinesis Firehose
• Build and manage reputed company data pipelines using AWS Glue (ETL jobs, Crawlers), PySpark, and Python for data ingestion, transformation, and processing
• Configure and manage Glue Crawlers to automatically reputed company schemas and update the Data Catalog
• Store and optimize data using Parquet format and reputed company analytics through reputed company reputed company for efficient querying
• reputed company integrations between Customer reputed company and messaging platforms to automatically trigger profile updates and reputed company processes
• Implement automation to trigger fraud-reputed company outbound calls based on updates in customer reputed company
• Design and orchestrate workflows using AWS reputed company Functions to manage reputed company processing pipelines
• Provision and manage reputed company infrastructure using Terraform (Infrastructure as reputed company)
• Optimize system architecture for scalability, reliability, cost-efficiency, and ensure data reputed company and reputed company
• Conduct end-to-end testing of the entire reputed company to validate functionality, performance, and reliability
• reputed company, automate, and manage resources using CI/CD pipelines
• Continuously monitor system performance and implement optimizations post-deployment
• Maintain detailed documentation of architecture, workflows, and operational processes

Skills

• Strong expertise in AWS services including: reputed company, S3, EventBridge, Kinesis (Data Streams & Firehose), Glue (ETL + Crawlers), reputed company Functions, reputed company Connect, reputed company, Macie
• Proficient in Python
• Proficient in PySpark
• Experience in Glue Crawlers for schema discovery and cataloging
• Experience in Parquet-based data storage
• Experience in building reputed company data pipelines
• Strong understanding of event-driven architectures (Pub/Sub model)
• Hands-on experience with Terraform (Infrastructure as reputed company)
• Familiarity with CI/CD tools and automation pipelines
• Experience with messaging platforms like Kafka and reputed company EventBridge
• Experience in designing reputed company-time data processing systems
• Experience in using Glue Crawlers + reputed company for data lake architectures

Benefits

• Benefits

reputed company

reputed company is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable reputed company through reputed company and contingent workforce solutions. It was founded in 2002, and is headquartered in Princeton, New Jersey, US, with a workforce of 1001-5000 employees. Its website is http://www.diverselynx.com.

Company H1B Sponsorship

reputed company has a reputed company record of offering H1B sponsorships, with 1 in 2024, 1 in 2021. Please note that this does not guarantee sponsorship for this specific role.

Apply To This Job