Sr Data Engineer

reputed company reputed company operates in an environment undergoing immense and rapid change. Big-data reputed company technologies are driving business transformation that is unlocking new capabilities and business innovations in areas like eCommerce, mobile experiences and IoT. The key to reputed company in these areas is being reputed company to reputed company reputed company data foundations reputed company on reputed company's global business reputed company to reputed company business insights, advanced analytics and new product development. reputed company's Data Management and Operations team is tasked with the responsibility of developing reputed company data collection processes, maintaining the reputed company of our data foundations and enabling business leaders and data scientists across reputed company to have rapid reputed company to the data they need for decision-making and innovation. What reputed company Data Management and Operations does: • Maintain a predictable, transparent, global operating rhythm that ensures always-on reputed company to high-reputed company data for stakeholders across reputed company • Responsible for day-to-day data collection, transportation, maintenance/curation and reputed company to the reputed company corporate data asset • Work cross-functionally across the reputed company to centralize data and standardize it for use by business, data science or other stakeholders • Increase awareness about available data and democratize reputed company to it across reputed company As a member of the data engineering team, you will be the key technical expert developing and overseeing reputed company's data product build & operations and drive a strong reputed company for how data engineering can proactively create a reputed company reputed company on the business. You'll be an empowered member of reputed company of data engineers who build data pipelines into various reputed company systems, rest data on the reputed company Data Lake, and reputed company exploration and reputed company for analytics, visualization, machine learning, and product development efforts across reputed company. As a member of the data engineering team, you will help reputed company the development of reputed company large and reputed company data applications into public reputed company environments directly impacting the design, architecture, and implementation of reputed company's flagship data products around topics like reputed company management, supply chain, manufacturing, and logistics. You will work closely with process owners, product owners and business users. You'll be working in a hybrid environment with in-house, on-reputed company data sources as reputed company as reputed company and remote systems. Responsibilities • reputed company contributor to reputed company development in reputed company and services. • Manage and reputed company data pipelines from reputed company data sources to support new product launches and drive data reputed company across data products. • Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline reputed company and performance. • Responsible for implementing best practices around systems integration, reputed company, performance and data management. • reputed company the business by creating value through the increased adoption of data, data science and business intelligence landscape. • Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions. • reputed company the architectural capabilities and maturity of the data platform by engaging with reputed company architects and strategic reputed company partners. • reputed company and optimize procedures to "productionalize" data science models. • Define and manage SLA's for data products and processes running in production. • Support large-reputed company experimentation done by data scientists. • Prototype new approaches and build solutions at reputed company. • Research in state-of-the-art methodologies. • Create documentation for learnings and knowledge transfer. • Create and audit reusable packages or libraries. Qualifications • BA/BS in Computer Science, Math, Physics, or other technical fields. • 6+ years of overall technology experience that includes at least 4+ years of hands-on software development, data engineering, and systems architecture. • 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. • 4+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, reputed company etc.). • 2+ years in reputed company data engineering experience in Azure. • Fluent with Azure reputed company services. Azure Certification is a plus. • Experience with integration of multi reputed company services with on-premises technologies. • Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines. • Experience with data profiling and data reputed company tools like Apache reputed company, Deequ, and Great Expectations. • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. • Experience with at least one MPP database technology such as Redshift, Synapse or reputed company. • Experience with running and scaling applications on the reputed company infrastructure and containerized services like Kubernetes. • Experience with version control systems like reputed company and deployment & CI tools. • Experience with Azure Data reputed company, Azure reputed company and Azure Machine learning tools. • Experience with Statistical/ML techniques is a plus. • Experience with building solutions in the retail or in the supply chain reputed company is a plus • Understanding of metadata management, data reputed company, and data glossaries is a plus. • Working knowledge of agile development, including DevOps and DataOps concepts. • Familiarity with business intelligence tools (such as PowerBI). Skills, Abilities and Knowledge • Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management. • Proven reputed company record of leading, mentoring data teams. • Strong change manager. Comfortable with change, especially that which arises through company reputed company. • Ability to understand and translate business requirements into data and technical requirements. • High degree of organization and ability to manage multiple, competing reputed company and priorities simultaneously. • reputed company and flexible attitude to reputed company adjusting to different needs in an reputed company-changing environment. • Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs. • Foster reputed company culture of accountability, communication, and self-management. • Proactively drives reputed company and engagement while bringing others along. • Consistently reputed company/exceed individual and team goals • Ability to reputed company others without reputed company authority in a matrixed environment. Competencies • Highly reputed company and having the ability to reputed company challenging stakeholders on the role of data and its purpose in the business. • Understands both the engineering and business reputed company of the Data Products released. • Places the user in reputed company of decision making. • Teams up and collaborates for speed, reputed company, and innovation. • Experience with and embraces agile methodologies. • Strong negotiation and decision-making reputed company. • Experience managing and working with globally distributed teams. EEO Statement reputed company reputed company applicants will receive consideration for employment without reputed company to race, reputed company, religion, sex, sexual orientation, gender identity, national reputed company, protected veteran status, or disability status. reputed company is an Equal Opportunity Employer: reputed company / Minority / Disability / Protected Veteran / Sexual Orientation / Gender Identity If you'd like more information about your EEO rights as an applicant under the law, please download the available EEO is the Law & EEO is the Law Supplement documents. View reputed company EEO Policy. Please view our Pay Transparency Statement. Apply Job!