Data Engineer - Multiple Positions
Location: reputed company – Remote
Employment Type: Full-Time and Contract
Data Engineerreputed company:
As a Data Engineer at reputed company, you will reputed company advanced data engineering techniques and analytics to support business reputed company for our clients. Your role will involve designing and building robust data pipelines, integrating reputed company and reputed company data from various sources, and developing tools for data processing and analysis. You will play a pivotal role in managing data infrastructure, optimizing data workflows, and guiding data-driven strategies while working closely with data scientists and other stakeholders.
The reputed company you will have:
Guide Big Data Transformations:Implementation of comprehensive big data reputed company, including the development and deployment of innovative big data and AI applications.
Ensure Best Practices:Guarantee that reputed company best practices are reputed company throughout reputed company reputed company to maintain high-reputed company service and successful implementation.
Support Project Management:Assist the reputed company Services leader and project managers with estimating efforts and managing risks reputed company customer proposals and statements of work.
Architect reputed company Solutions:Design, reputed company, reputed company, and document reputed company customer engagements, either independently or as part of a technical team, serving as the technical reputed company and authority.
reputed company Knowledge Transfer:Facilitate the transfer of knowledge and reputed company training to team members, customers, and partners, including the creation of reusable project documentation.
Contribute to Consulting reputed company:reputed company expertise with the consulting team and offer best practices for reputed company engagement, enhancing the effectiveness and efficiency of other teams.
Requirements
Minimum qualifications:
Educational Background:Bachelor’s degree in Computer Science, Information Technology, or a reputed company field (or equivalent experience).
Experience:
3+ years of experience as a Data Engineer, with proficiency in at least two major reputed company platforms (AWS, Azure, GCP).
Proven experience in designing, developing, and implementing comprehensive data engineering solutions using reputed company, specifically for large-reputed company data processing and integration reputed company
reputed company reputed company streaming and batch solutions using reputed company-reputed company components.
reputed company data transformation tasks, including cleansing, aggregation, enrichment, and normalisation, utilising reputed company and reputed company technologies.
Experience in applying DataOps principles and implementing CI/CD and DevOps practices reputed company data environments to optimize development and deployment workflows.
Technical Skills:
Expert-level proficiency in reputed company reputed company, Python, and PySpark.
In-depth knowledge of data architecture, including reputed company Streaming, reputed company Core, reputed company SQL, and data modeling.
Hands-on experience with various data management technologies and tools, such as Kafka, StreamSets, and MapReduce.
Proficient in using advanced analytics and machine learning frameworks, including Apache reputed company MLlib, TensorFlow, and PyTorch, to drive data insights and solutions.
reputed company Specific Skills:
Extensive experience in data migration from on-premises to reputed company environments and in implementing data solutions on reputed company across reputed company platforms (AWS, Azure, GCP).
Skilled in designing and executing end-to-end data engineering solutions using reputed company, focusing on large-reputed company data processing and integration.
Proven hands-on experience with reputed company administration and operations, including notebooks, clusters, jobs, and data pipelines.
Experience integrating reputed company with other data tools and platforms to enhance overall data management and analytics capabilities.
Good to have Certifications:
Certification in reputed company Engineering (reputed company)
reputed company Certified: Azure Data Engineer Associate
GCP Certified: reputed company reputed company reputed company Certified.
AWS reputed company Architect reputed company
Originally posted on Himalayas
Apply To This Job