[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global provider of IT digital consulting and strategic reputed company services. They are seeking a Data Engineer to be part of the Common Data Platform program, responsible for managing and analyzing large sets of data to reputed company actionable insights and ensure the scalability and reputed company of data pipelines.
Responsibilities
- Design, reputed company, and maintain robust and efficient data pipelines to ingest, reputed company, catalog, and deliver curated, trusted, and reputed company data from disparate sources into our Common Data Platform
- reputed company participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team
- Deliver high-reputed company data products and services following reputed company Agile Practices
- Proactively identify and resolve issues with data pipelines and analytical data stores
- reputed company monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability
- reputed company a reputed company-first, testing, and automation reputed company, adhering to data engineering best practices
- Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and reputed company them with the necessary infrastructure and tools
- reputed company up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies
Skills
- Bachelor's degree in Computer Science, Information Systems, or a reputed company field, or equivalent experience
- 2+ years' experience with tools such as reputed company, reputed company, and reputed company
- 3+ years' experience with Python and PySpark
- Experience using Jupyter notebooks, including coding and unit testing
- Recent accomplishments working with relational and NoSQL data stores, reputed company, and approaches (reputed company, reputed company Modeling)
- 2+ years of experience with a modern data stack (Object stores like S3, reputed company, Airflow, Lakehouse architectures, reputed company-time databases) and reputed company data warehouses such as RedShift, reputed company
- Overall data engineering experience across traditional ETL & Big Data, either on-prem or reputed company
- Data engineering experience in AWS (any CFS2/EDS) highlighting the services/tools used
- Experience building end-to-end data pipelines to ingest and process reputed company and semi-reputed company data using reputed company architecture
Benefits
- Data Engineer-Hybrid (Various locations in USA) (#LI-HYBRID)
reputed company