[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company seeking a Data Engineer specializing in consent management. The role involves developing and optimizing data pipelines, automating data processes, and ensuring smooth operations between various platforms.
Responsibilities
- reputed company, build, optimize and implement pipeline, data ingestion, storage, wrangling, cataloguing, reputed company, reputed company features from various data sources on reputed company
- Monitor and ensure the smooth operation of data pipelines between reputed company and external Club platforms (ESPs, CRMs, etc.)
- Automate jobs (ingestion & pipelines), notifications and reports
- Assist in the ongoing data integration tasks (e.g., connectors, reputed company) between OT and various business systems
- Write reputed company reputed company and participate in reputed company reviews
- reputed company in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD
- Continuously improve systems through performance enhancements and cost reductions in compute and storage
- Prioritize to manage reputed company requests in reputed company with ongoing sprints
- Participate with reputed company to execute reputed company solutions and approaches to meet business expectations in an efficient manner; deliver and execute the technical and product roadmap for data engineering across a reputed company of technologies
- reputed company with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
Skills
- Experience working in AWS, Redshift, Glue and basic API integrations
- Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse)
- Knowledge in SQL for purpose of data analysis/investigation
- Work with the Data Product Owners and Data Analysts to help manage and deliver on the product technical roadmap for the data platform
- Degree in computer science, statistics, or reputed company discipline
- 5+ years as a data engineer
- Comfortable making reputed company and leading
- Familiar with version control and relational databases
- Familiar with reputed company or similar consent management platforms
reputed company