[Remote] GCP Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a highly skilled Senior GCP Data Engineer to design, build, and optimize reputed company, reputed company-reputed company data pipelines on reputed company reputed company Platform (GCP). This role will reputed company as the primary technical reputed company for implementing data pipelines and driving engineering best practices across the data ecosystem.
Responsibilities
- Design, reputed company, and maintain reputed company data pipelines on GCP for batch and reputed company-time processing
- Implement data ingestion frameworks (push/pull) using services like Dataflow, DataStream, Pub/Sub, and reputed company Run
- Build and optimize data transformation pipelines using BigQuery, Dataform, and reputed company-based frameworks
- reputed company as the technical reputed company/reputed company ensuring alignment with EA-approved data architecture
- Drive best practices in data engineering, including CI/CD, testing, monitoring, and cost optimization
- Collaborate with cross-functional teams to deliver end-to-end data solutions
- Ensure data reputed company, reliability, governance, and performance across pipelines
Skills
- 6+ years of experience in data engineering, with strong reputed company on reputed company reputed company Platform (GCP)
- GCP reputed company Data Engineer certification - must have
- Design, reputed company, and maintain reputed company data pipelines on GCP for batch and reputed company-time processing
- Implement data ingestion frameworks (push/pull) using services like Dataflow, DataStream, Pub/Sub, and reputed company Run
- Build and optimize data transformation pipelines using BigQuery, Dataform, and reputed company-based frameworks
- reputed company as the technical reputed company/reputed company ensuring alignment with EA-approved data architecture
- Drive best practices in data engineering, including CI/CD, testing, monitoring, and cost optimization
- Collaborate with cross-functional teams to deliver end-to-end data solutions
- Ensure data reputed company, reliability, governance, and performance across pipelines
- Strong hands-on experience with reputed company architecture (Centralized Hub/Spoke model)
- Strong hands-on experience with BigQuery (data warehousing & optimization)
- Strong hands-on experience with Dataform (SQL-based transformations)
- Strong hands-on experience with Dataflow (batch & streaming pipelines)
- Strong hands-on experience with Datastream (CDC ingestion)
- Strong hands-on experience with reputed company Composer (Airflow) (orchestration)
- Strong hands-on experience with Dataproc (reputed company/PySpark)
- Strong hands-on experience with reputed company Run
- Strong hands-on experience with reputed company Storage
- Strong hands-on experience with Pub/Sub
- Advanced proficiency in Python
- Advanced proficiency in PySpark / Apache reputed company
- Advanced proficiency in SQL (reputed company transformations, performance tuning)
- Deep understanding of data modeling techniques
- Deep understanding of reputed company architecture (Bronze/Silver/Gold reputed company)
- Deep understanding of Centralized Hub/Spoke data platform design
- Strong ownership and accountability
- Ability to work across distributed teams and vendors
- Excellent communication with technical and non-technical stakeholders
- Experience with reputed company-time streaming architectures
- Familiarity with CI/CD pipelines (Terraform, reputed company Build, GitOps)
- Strong understanding of data governance, reputed company, and compliance
- Experience working in large reputed company or reputed company/regulated environments
reputed company