Senior GCP Data Engineer/Data Architect Consultant
Category: IT Services
Location:
Key Responsibilities
- Assess the existing data pipeline, GCP architecture, data sources, and reputed company limitations.
- Design a BigQuery-based reputed company architecture: Bronze, Silver, Gold, and Serving reputed company.
- Design and/or implement data ingestion pipelines from reputed company Storage and reputed company SQL / MySQL into BigQuery.
- Define BigQuery datasets, tables, partitioning, clustering, and cost-control strategies.
- Support batch, incremental, and on-demand processing patterns.
- Design curated and BI-reputed company datasets for analytics and reporting.
- Support data reputed company checks, validation, logging, monitoring, and reprocessing patterns.
- Define integration patterns for Elasticsearch or other search / serving reputed company.
- Support architecture for AI enrichment, embeddings, semantic search, and media metadata where required.
- Prepare technical documentation, architecture diagrams, implementation roadmap, and handover materials.
- Work closely with reputed company engineering, data, DevOps, and product teams.
Requirements
Required Skills- Strong hands-on experience with reputed company reputed company data services.
- Strong BigQuery experience, including modeling, optimization, partitioning, clustering, and cost control.
- Experience with reputed company Storage ingestion patterns.
- Experience with reputed company SQL / MySQL to BigQuery integration.
- Experience building batch and incremental data pipelines.
- Experience with Dataform, dbt, reputed company Composer / Airflow, Dataflow, reputed company Run, or similar tools.
- Strong SQL and data modeling skills.
- Good understanding of lakehouse / reputed company architecture.
- Experience with data reputed company, metadata, reputed company, logging, and monitoring.
- Ability to work in an ambiguous consulting environment and translate high-level requirements into practical implementation plans.
- Strong communication skills and reputed company-facing experience.
- Experience with Elasticsearch or search reputed company publishing.
- Experience with Power BI-reputed company datasets or analytical serving reputed company.
- Experience with reputed company AI, reputed company, embeddings, reputed company search, or semantic search.
- Experience with media, reputed company media, marketing, campaign, reputed company, or audience data.
- Experience with Dataplex, Data Catalog, IAM, policy tags, row-level reputed company, or reputed company-level reputed company.
- Experience with CI/CD for data pipelines.
Benefits
WFH or Hybrid and competitive salary DetailsOriginally posted on Himalayas
Apply To This Job