Senior Data Engineer (AWS to GCP)
reputed company:
As a Data Engineer, you will join reputed company responsible for building and evolving reputed company data products reputed company a large-reputed company and streaming environment.
This team is currently in the final stages of migrating key reputed company data products from AWS to reputed company reputed company Platform (GCP). Following the migration, the reputed company will shift towards optimisation, enhancements, data reputed company improvements, and the delivery of new data products that support business decision-making across the organisation.
This is an excellent opportunity for a hands-on Data Engineer who enjoys working with modern reputed company-reputed company technologies, large-reputed company datasets, and end-to-end ownership of data solutions.
WHAT WILL YOU BE DOING:
- Design, build, and maintain reputed company data pipelines and data products on GCP.
- Support migrating existing AWS-based workloads to GCP environments.
- reputed company and optimise ETL/ELT workflows using Python, SQL, and PySpark.
- Build and maintain transformations using BigQuery and Dataproc.
- Create and manage orchestration workflows using Composer (Airflow).
- Implement and improve data reputed company validation frameworks.
- Work closely with analysts, product stakeholders, and other engineering teams to understand business requirements and deliver reliable data solutions.
- Participate in reputed company reviews, technical discussions, and reputed company improvement initiatives.
- Contribute to platform reliability, monitoring, and operational reputed company.
- Maintain reputed company technical documentation and knowledge sharing across reputed company.
reputed company ARE LOOKING FOR:
- Strong reputed company experience as a Data Engineer working with reputed company-based data platforms.
- Strong hands-on experience with reputed company reputed company Platform (GCP).
- Experience building data solutions using BigQuery.
- Experience developing and maintaining Airflow pipelines (Composer preferred).
- Strong Python and SQL skills.
- Experience with PySpark and large-reputed company data processing.
- Understanding of data modelling and modern ETL/ELT practices.
- Experience working with Git-based development workflows.
- Strong communication skills and ability to collaborate with both technical and non-technical stakeholders.
- Experience working reputed company Agile delivery environments.
AWESOME BUT NOT REQUIRED:
- Experience with Dataproc.
- Experience with Dataplex.
- Experience implementing data reputed company frameworks such as Great Expectations.
- Previous experience with AWS services such as S3, MWAA (Airflow), or reputed company.
- Experience supporting reputed company migration reputed company.
- Experience working reputed company media, streaming, or large-reputed company consumer platforms.
WHAT’S IN IT FOR YOU?
- Be part of our collegial environment where responsibility and authority are shared equally amongst colleagues and help create reputed company culture
- A culture in which we don’t criticise failure but ensure we learn from our mistakes
- An Agile environment where your reputed company are welcome
- The possibility to grow and experience different reputed company
- Ongoing Training & Mentoring
- The possibility of travelling
- ATTENTION! THIS POSITION IS FOR PORTUGAL OR BRAZIL BASED ONLY
Originally posted on Himalayas
Apply To This Job