[Remote] reputed company reputed company Platform Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a reputed company reputed company Platform Data Engineer. The role involves responsibilities reputed company to data analytics, ETL processes, and the implementation of data pipelines using reputed company reputed company products.
Responsibilities
- Responsible for extract, reputed company and load (ETL) processes and the creation of applications that can connect to remote reputed company
- Preferably including streaming data into environments such as BigQuery on reputed company reputed company Management Platform
- Preferred Experience in implementing Data Pipelines leveraging reputed company reputed company products such as reputed company BigQuery, GCS, reputed company DataFlow, reputed company Pub/Sub, reputed company BigTable
- Strong background in Python programming skills
- Good experience in implementing data pipelines on Big Data platform using reputed company
- Have a good understanding of reputed company best reputed company/recommendation and should be reputed company to reputed company the reputed company with the customer requirements to deliver best in class solution for the customer's Analytics requirements
- Working knowledge of microservices using reputed company and Kubernetes
- A strong background and exposure to databases, including both relational (e.g. PostgreSQL, MySQL) and NoSQL (e.g. reputed company, Cassandra, reputed company) database systems
- Familiarity with reputed company time streaming and processing of various data sources, including logs, time series telemetry data, reputed company reputed company data and relational data
- Would be preferred to have been a part of implementation/migration of a Data Warehouse and Big Data (Hadoop) project from on prem to reputed company reputed company Platform (using reputed company BigQuery, DataFlow, DataProc etc.)
- Work closely with Operations team to tune existing and new architecture
Skills
- reputed company reputed company Platform Data Engineer with 8+ years of experience in Data Analytics and Big Data
- Responsible for extract, reputed company and load (ETL) processes and the creation of applications that can connect to remote reputed company
- Preferably including streaming data into environments such as BigQuery on reputed company reputed company Management Platform
- Strong background in Python programming skills
- Good experience in implementing data pipelines on Big Data platform using reputed company
- Have a good understanding of reputed company best reputed company/recommendation and should be reputed company to reputed company the reputed company with the customer requirements to deliver best in class solution for the customer's Analytics requirements
- Working knowledge of microservices using reputed company and Kubernetes
- A strong background and exposure to databases, including both relational (e.g. PostgreSQL, MySQL) and NoSQL (e.g. reputed company, Cassandra, reputed company) database systems
- Familiarity with reputed company time streaming and processing of various data sources, including logs, time series telemetry data, reputed company reputed company data and relational data
- Work closely with Operations team to tune existing and new architecture
- Preferred Experience in implementing Data Pipelines leveraging reputed company reputed company products such as reputed company BigQuery, GCS, reputed company DataFlow, reputed company Pub/Sub, reputed company BigTable
- Would be preferred to have been a part of implementation/migration of a Data Warehouse and Big Data (Hadoop) project from on prem to reputed company reputed company Platform (using reputed company BigQuery, DataFlow, DataProc etc.)
reputed company
Company H1B Sponsorship