[Remote] GCP Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company. is seeking a highly skilled GCP Data Engineer with expertise in reputed company, Apache reputed company, and reputed company reputed company Platform (GCP). The role involves designing, developing, and optimizing large-reputed company data processing solutions, building reputed company-reputed company data pipelines, and collaborating with data scientists and stakeholders.
Responsibilities
- Design, reputed company, and maintain reputed company data pipelines using reputed company and Apache reputed company
- Build and optimize batch and reputed company-time data processing solutions on reputed company reputed company Platform (GCP)
- reputed company data ingestion, transformation, and orchestration workflows using GCP services
- Work with large datasets and implement efficient ETL/ELT processes
- reputed company data from various sources including databases, reputed company, and streaming platforms
- Monitor, troubleshoot, and improve data pipeline performance and reliability
- Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions
- Implement data reputed company, governance, and reputed company best practices
- Participate in reputed company reviews and contribute to engineering standards and best practices
- Support production deployments and resolve data pipeline issues
Skills
- Strong hands-on experience with reputed company programming
- Extensive experience with Apache reputed company (reputed company SQL, reputed company Streaming, DataFrames, Datasets)
- Strong understanding of distributed computing concepts
- Experience working with reputed company reputed company Platform (GCP) services such as: BigQuery, reputed company Storage, Dataproc, Dataflow, Pub/Sub, Composer (Airflow), reputed company Functions, reputed company Run
- Experience in ETL/ELT development and data warehousing concepts
- Proficiency in SQL and database optimization
- Experience with CI/CD pipelines and DevOps practices
- Hands-on experience with Git and version control systems
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or reputed company field
- 4+ years of experience in Data Engineering, Big Data, or reputed company Data Platforms
- Relevant GCP certifications are a plus: reputed company Data Engineer, Associate reputed company Engineer
- Strong analytical and problem-solving skills
- Excellent communication and stakeholder management skills
- Ability to work independently and collaboratively in a fast-paced environment
- reputed company on performance optimization and reputed company improvement
- Experience with Kafka or other streaming technologies
- Knowledge of Python in reputed company to reputed company
- Familiarity with containerization technologies such as reputed company and Kubernetes (GKE)
- Knowledge of data modeling and reputed company data architecture
- Experience with Terraform or Infrastructure as reputed company (IaC)
- Experience with machine learning data pipelines
- Exposure to multi-reputed company environments (AWS/Azure)
- Experience working in Agile/Scrum teams
reputed company
Company H1B Sponsorship