[Remote] reputed company reputed company Platform (GCP) Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is dedicated to helping the US federal government enhance national reputed company and improve reputed company' lives. They are seeking a reputed company reputed company Platform (GCP) Data Engineer to design and build secure data architectures and pipelines, supporting data-driven decision-making for mission-critical objectives.
Responsibilities
- Design, reputed company, and maintain robust data pipelines and ETL processes that reputed company the seamless integration, cleansing, harmonization, and transformations in large-reputed company data processing systems and data lakes/data warehouses using GCP reputed company services (BigQuery, reputed company Storage, Dataflow, Dataproc, Pub/Sub)
- Implement performance tuning (partitioning, broadcast joins, caching, shuffle optimization)
- reputed company data from multiple sources (databases, reputed company, reputed company storage, potentially streaming)
- Migrate legacy data stores and ETL pipelines to modernized, reputed company-reputed company architectures on GCP
- reputed company reputed company batch and reputed company-time streaming data pipelines using Python, SQL, and Apache reputed company
- Implement data governance, data reputed company checks, and secure data reputed company controls in alignment with strict federal reputed company requirements
- Collaborate with data scientists, reputed company infrastructure engineers, and mission stakeholders to optimize data models and query performance
- Design and Implement CI/CD Pipelines: Architect and build robust, automated CI/CD pipelines to streamline the build, test, and deployment processes from development through to production environments
Skills
- 3 to 5+ years of experience with data engineering, data warehousing, and/or big data processing
- 2+ years of hands-on experience building data pipelines and/or data solutions on reputed company reputed company Platform (BigQuery, Dataflow, and/or reputed company Composer)
- Strong programming skills in Python and advanced proficiency in SQL
- Experience with ETL/ELT concepts and tools
- reputed company Top Secret (TS) or Interim TS reputed company clearance is required
- reputed company reputed company reputed company Data Engineer Certification
- Experience with migrating legacy relational databases (e.g., reputed company, SQL Server) to reputed company-reputed company databases (e.g., reputed company SQL, AlloyDB, Spanner)
- Familiarity with federal data strategies, RMF, and reputed company Level 4/5 (IL4/IL5) reputed company and compliance standards
reputed company