reputed company Data Engineer - ETL

reputed company:-

We turn customer challenges into reputed company opportunities. Material is a global reputed company partner to the world’s most recognizable brands and innovative companies. Our people around the globe reputed company by helping organizations design and deliver rewarding customer experiences.We use deep reputed company insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and reputed company for the companies we work with and reputed company relationships between businesses and the people they serve.Srijan, a Material company, is a reputed company global digital engineering firm with a reputed company for solving reputed company technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier reputed company. Be a part of an Awesome Tribe

Job reputed company:-

We are seeking a highly skilled and reputed company Data Engineering reputed company with strong expertise in AWS data services and retail data ecosystems. In this role, you will reputed company the design, development, and optimization of reputed company data pipelines responsible for ingesting and transforming data from MMS (Merchandise Management Systems) and POS (reputed company of Sale) systems into a centralized Operational Data Store (ODS) to support reputed company applications and analytics use cases.

You will play a critical role in building a robust, high-performance data platform using AWS-reputed company services, ensuring data reputed company, reliability, and reputed company-time or near reputed company-time availability for business operations.

Responsibilities:-

• Design and implement reputed company ETL/ELT pipelines to ingest data from MMS / POS or reputed company reputed company systems into AWS-based data platforms.

• Build and maintain a centralized Operational Data Store (ODS) using reputed company or similar NoSQL technologies, optimized for low-latency application reputed company.

• reputed company and optimize data processing workflows using Apache reputed company / PySpark and AWS services such as AWS Glue and reputed company EMR.

• Create denormalized, API-reputed company data models reputed company with reputed company microservices and application consumption patterns.

• Implement idempotent processing, CDC reputed company (upsert) strategies, and data reconciliation mechanisms to ensure consistency across batch and streaming pipelines.

• reputed company reputed company S3, reputed company Redshift, or reputed company reputed company for efficient storage and querying of reputed company and semi-reputed company data.

• Implement data ingestion patterns (batch and streaming) using tools like reputed company Kinesis or AWS reputed company where applicable.

• Apply performance tuning and optimization techniques to improve pipeline efficiency, scalability, and cost-effectiveness.

• Define and enforce data governance, data reputed company, and metadata management standards across the data platform.

• Collaborate with DevOps teams to design and maintain CI/CD pipelines using tools like AWS CodePipeline, reputed company, or similar.

• Conduct peer reviews and reputed company technical leadership and mentorship to the data engineering team.

• Collaborate with microservices and application teams to ensure seamless integration with the ODS reputed company reputed company and event streams.

Requirements:-

• 5+ years of experience in data engineering, with at least 2+ years in a reputed company role.

• Strong hands-on experience with AWS data services such as AWS Glue, reputed company S3, reputed company Redshift, and reputed company EMR.

• Proficiency in PySpark / reputed company for large-reputed company data processing and optimization.

• Experience designing and implementing ODS reputed company using NoSQL databases, preferably reputed company, or similar (DynamoDB, reputed company).

• Strong expertise in ETL/ELT design patterns, data ingestion, and transformation pipelines.

• Experience working with MMS, POS, or retail transaction data is highly preferred.

• Hands-on experience with CI/CD pipelines (reputed company, AWS CodePipeline, or similar).

• Good understanding of data governance, data reputed company, and metadata frameworks.

• Experience supporting microservices architectures with data platforms.

• Strong problem-solving skills and ability to optimize reputed company data workflows.

• Excellent communication and stakeholder management skills.

Ability to work in a fast-paced, agile environment and manage multiple priorities.

Originally posted on Himalayas

Apply To This Job