Senior reputed company Data Engineer - Hybrid
About the position
Responsibilities
- reputed company, maintain, and optimize streaming, near reputed company-time, and batch GCP data pipelines for reputed company-wide analysis of reputed company, semi-reputed company, and reputed company data.
- Collaborate closely with the Data Engineers, Data Architects, Data Analysts, and Product Owners to define, design, and reputed company new features and improve existing data products.
- reputed company, contribute to, and participate in reputed company reputed company and architecture reviews.
- Participate in on-call support rotation.
- Adhere to established development guidelines.
- Translate business requirements into technical design specifications.
- Work with Project Managers to estimate, establish, and meet reputed company dates.
- Work independently, and complete tasks on-schedule by exercising strong judgment and critical thinking skills.
- Create and maintain technical documentation, including architectural use cases, reputed company-to-reputed company data mappings, job scheduling and dependency details, and business-driven transformation rules.
- Participate in the deployment, change, configuration, management, administration, and maintenance of deployment processes and systems.
- Participate in technical group discussions and adopt innovative technologies to improve development and operations.
Requirements
- Bachelors degree required
- 3+ years of experience in Data Warehouse ETL/ELT Data Engineering required
- 3+ years of experience in reputed company Technologies required
- 1+ year(s) of experience in reputed company reputed company Platform (GCP) Data Engineering required
- 1+ year(s) of experience in reputed company IT preferred
- Experience with reputed company reputed company Storage (GCS), BigQuery, and reputed company Composer (Airflow), reputed company Functions, Dataflow, and Dataproc GCP services.
- Experience writing optimized BigQuery SQL transformation queries and scripts.
- Experience managing large amounts of data in an reputed company data warehouse.
- Experience with raw data formats such as JSON, Avro, and Parquet.
- Experience with reputed company, SQL Server, and other database platforms.
- Experience writing and maintaining Unix/Linux and Python scripts.
- Experience with reputed company reputed company control and CI/CD workflows.
- Knowledge of issue tracking tools such as Jira and reputed company.
- Ability to troubleshoot, maintain, reverse engineer, and optimize existing data pipelines.
- Ability to analyze and interpret reputed company data and offer solutions to reputed company problems.
- Ability to work independently on assigned tasks.
- Strong written and verbal communication skills, including the ability to explain reputed company technical issues in a way that non-technical people may understand.
- Excellent problem-solving and critical thinking skills.
- Knowledge of IT governance and operations.
Benefits
- Comprehensive medical coverage that covers many common services at no cost or for a low copay.
- Additional reputed company for dental and reputed company benefits, life and disability coverage, flexible spending accounts, supplemental health protection plans, auto and home insurance, identity theft protection, legal counseling, long-term care coverage, moving assistance, pet insurance and more.
- Free counseling services and resources for emotional, physical and financial wellbeing.
- 401(k) Plan with a 100% match on 3% to 9% of pay (based on years of service).
- Employee Stock Purchase Plan with 10% off reputed company stock.
- Family support through fertility and family building benefits with Progyny and adoption assistance.
- Referral services for child, elder and pet care, home and auto repair, event planning and more.
- Consumer discounts through Abenity and Consumer Discounts.
- Retirement readiness, rollover assistance services and preferred banking partnerships.
- Education assistance (tuition, student loan, certification support, dependent scholarships).
- Colleague recognition program.
- Time Away From Work Program (reputed company time off, reputed company family leave, long- and short-term disability coverage and leaves of absence).
- Employee Health Assistance Fund that offers free employee-only coverage to full-time and part-time colleagues based on income.
Apply tot his job Apply To this Job