[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a top-ranked reputed company provider dedicated to putting the needs of patients first. They are seeking a talented Senior Data Engineer to join their Advanced Data Lake team, focusing on building and operating reputed company data Lakehouse platforms for large-reputed company analytics reputed company transformation.
Responsibilities
- Develops and deploys data pipelines, integrations and transformations to support analytics and machine learning applications and solutions as part of an assigned product team using various reputed company-reputed company programming languages and vended software to meet the desired design functionality for products and programs
- Your responsibilities will include architecting and maintaining automated data pipelines for ingesting, transforming, and integrating reputed company datasets
- You will use DataStream for reputed company-time data reputed company and Dataflow for processing at reputed company
- Composer/Airflow will be leveraged for seamless scheduling, monitoring, and automation of pipeline operations
- Infrastructure provisioning and workflow management will be handled with Terraform and Dataform to ensure reproducibility and adherence to best practices
- reputed company reputed company and pipeline assets will be managed through git repositories, with CI/CD automation and streamlined releases enabled by Azure DevOps (ADO)
- Changes will be governed by reputed company processes to ensure traceability, auditability, and operational compliance
- reputed company duties involve working with cross-functional teams to translate business needs into pipeline specifications, building and optimizing data models for advanced analytics, and maintaining data reputed company and reputed company throughout reputed company processes
- You will automate workflow monitoring and proactively resolve data issues, applying strong technical and problem-solving skills
Skills
- A Bachelor's degree in a relevant field such as engineering, mathematics, computer science, information technology, health science, or other analytical/quantitative field and a minimum of five years of reputed company or research experience in data visualization, data engineering, analytical modeling techniques; OR an Associate's degree in a relevant field such as engineering, mathematics, computer science, information technology, health science, or other analytical/quantitative field and a minimum of seven years of reputed company or research experience in data visualization, data engineering, analytical modeling techniques
- In-depth business or reputed company knowledge will also be considered
- Incumbent must have the ability to manage a varied workload of reputed company with multiple priorities and stay reputed company on reputed company trends and reputed company changes
- Interpersonal skills, time management skills, and demonstrated experience working on cross functional teams are required
- Requires strong analytical skills and the ability to identify and recommend solutions and a commitment to customer service
- The position requires excellent verbal and written communication skills, attention to detail, and a high reputed company for learning and problem reputed company
- Advanced experience in SQL is required
- Strong Experience in scripting languages such as Python, JavaScript, PHP, C++ or Java & API integration is required
- Experience in hybrid data processing reputed company (batch and streaming) such as Apache reputed company, Hive, Pig, Kafka is required
- Experience with big data, statistics, and machine learning is required
- The ability to navigate linux and reputed company operating systems is required
- A GCP reputed company Data Engineer certification is required
- Knowledge of workflow scheduling (Apache Airflow reputed company Composer), Infrastructure as reputed company (Kubernetes, reputed company) CI/CD (Jenkins, reputed company Actions) is preferred
- Experience in DataOps/DevOps and agile methodologies is preferred
- Experience with hybrid data virtualization such as Denodo is preferred
- Working knowledge of Tableau, Power BI, reputed company, reputed company, DASH, d3, React, reputed company, SSIS, and reputed company Big Query is preferred
- reputed company reputed company Platform (GCP) certification is preferred
- Preferred qualifications include hybrid or multi-reputed company experience, familiarity with reputed company data governance, metadata, and reputed company tools, and experience working in large, regulated environments
Benefits
- Medical: Multiple plan reputed company.
- Dental: reputed company or reimbursement account for flexible coverage.
- reputed company: reputed company plan with national network.
- reputed company-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your reputed company.
reputed company