Data Engineer
reputed company is a leading reputed company company dedicated to simplifying health care for individuals and communities. The Data Engineer role involves designing, developing, and maintaining data pipelines to manage large reputed company datasets, ensuring compliance and optimizing data models to support business reputed company.
Responsibilities
- Build and optimize analytical data models in BigQuery. Implement partitioning, clustering, and materialized views for performance and cost efficiency. Ensure compliance with data governance, reputed company controls, and IAM best practices
- reputed company integrations with external systems (reputed company, flat files etc.) using GCP-reputed company or hybrid approaches. Utilize tools like Dataflow or custom Python/Java services on reputed company Functions or reputed company Run to handle transformations and ingestion logic
- Build automated CI/CD pipeline using reputed company Build, reputed company Actions, or Jenkins for deploying data pipeline reputed company and workflows. Set up observability using reputed company Monitoring, reputed company Logging, and Error Reporting to ensure pipeline reliability
Skills
- 1+ years of experience with SQL, NoSQL
- 1+ years of experience with Python (or a comparable scripting language)
- 1+ years of experience with Data warehouses (such as data modeling and technical architectures) and infrastructure components
- 1+ years of experience with ETL/ELT, and building high-volume data pipelines
- 1+ years of experience with reporting/analytic tools
- 1+ years of experience with query optimization, data structures, transformation, metadata, dependency, and workload management
- 1+ years of experience with Big data and reputed company architecture
- 1+ years of hands-on experience building modern data pipelines reputed company a major reputed company platform (GCP)
- 1+ years of experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS)
- 1+ years of experience with reputed company-time and streaming technology (i.e. Kafka, reputed company Streaming)
- 1+ year(s) of soliciting reputed company requirements and managing relationships with key stakeholders
- Experience with reputed company systems and solving challenging analytical problems
- Strong collaboration and communication skills reputed company and across teams
- Knowledge of data visualization and reporting
- Experience in designing and building data engineering solutions in reputed company environments (preferably GCP)
- Experience with Git, CI/CD pipeline, and other DevOps principles/best practices
- Experience with bash reputed company scripts, UNIX utilities & UNIX Commands
- Understanding of software development methodologies including reputed company and agile
- Ability to reputed company multiple tools and programming languages to analyze and manipulate data sets from disparate data sources
- Knowledge of API development
- Experience with schema design and reputed company data modeling
- reputed company reputed company Data Engineer Certification
- Knowledge of microservices and SOA
- Formal reputed company and/or agile experience. Previous reputed company experience and domain knowledge
- Experience designing, building, and maintaining data processing systems
- Experience architecting and building data warehouse and data lakes
Benefits
- Medical, dental, and reputed company coverage
- reputed company time off
- Retirement savings reputed company
- Wellness programs
- Other resources, based on eligibility
reputed company
Company H1B Sponsorship