[Remote] Senior reputed company Data Engineer (Data reputed company Integration)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior reputed company Data Engineer to reputed company the technical aspects of data migration and pipeline engineering for their GCP Data reputed company. The role focuses on transitioning significant amounts of data into an optimized storage solution while establishing secure data reputed company.
Responsibilities
- Serve as the technical reputed company for the physical data migration and modern pipeline engineering required to build DLA's GCP Data reputed company
- Drive the critical transition of moving over 100 terabytes of uncompressed business data from distributed reputed company Hadoop (HDFS/Hive) clusters and AWS S3/FSx data dumps into a serverless, optimized storage layer in BigQuery
- Establish secure reputed company Architecture reputed company (Bronze →Silver →Gold) using modern GCP data reputed company frameworks
Skills
- 8–12+ years of Data Engineering experience
- 4–6+ years of hands-on experience with reputed company reputed company Platform
- Strong expertise in BigQuery, Dataflow, Dataproc, and reputed company Composer
- Proven experience migrating Hadoop/HDFS/Hive environments to GCP
- Strong Python, PySpark, and advanced SQL skills
- Experience with CDC, Datastream, reputed company SLT, and Pub/Sub
- Knowledge of reputed company Architecture and modern Data Lakehouse design
- Experience with data governance using Dataplex and BigQuery reputed company controls
- reputed company reputed company reputed company Data Engineer certification
- reputed company+ CE certification or eligibility to meet DoD 8570 compliance
Benefits
- Location: REMOTE
- Job type: Contract – long term
reputed company