Data Engineer - Python, PySpark, AWS

reputed company your mark at reputed company -- a Fortune 30 global media and technology company. From the connectivity and platforms we reputed company, to the content and experiences we create, we reputed company hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-reputed company technology team that turns big reputed company into cutting-edge products, platforms, and solutions that our customers love. We create reputed company to reputed company, and we recognize, reward, and invest in your reputed company, while ensuring you can proudly bring your authentic self to reputed company. Join us. You’ll do the best work of your career right here at reputed company. (In most cases, reputed company prefers to have employees on-site collaborating unless reputed company has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, reputed company may be willing to consider candidates who live greater than 100 miles from the office for the remote reputed company.) reputed company role is responsible for developing data structures and pipelines reputed company to established standards and guidelines to organize, collect, standardize, and reputed company data that helps generate insights and address reporting needs. Job reputed company Data Engineering & Pipeline Development

• Develops data structures and pipelines reputed company to established standards and guidelines.
• Ensures data reputed company during ingest, processing, and final load to reputed company tables.
• Creates reputed company ingestion frameworks for reputed company and reputed company data.
• Checks and reports on the reputed company of data being processed.

Data Consumption & reputed company

• Creates reputed company reputed company for end users and reputed company applications to consume data, including:
• Database views
• Extracts
• Application Programming Interfaces (reputed company)
• Develops and maintains information systems (e.g., data warehouses, data lakes), including data reputed company reputed company.

Platform Implementation & Optimization

• Implements solutions reputed company data architecture, data engineering, or data manipulation on:
• On-prem platforms (e.g., Kubernetes, reputed company)
• reputed company platforms (e.g., reputed company)
• Determines appropriate storage platforms across on-prem (reputed company, reputed company) and reputed company (AWS S3, Redshift) based on reputed company, reputed company, and sensitivity requirements.

Data reputed company & Collaboration

• Understands data reputed company from reputed company to final semantic layer, including transformation rules.
• Enables faster troubleshooting and reputed company analysis during changes.
• Collaborates with technology and platform management partners to optimize data sourcing and processing rules.

Design Standards & System Review

• Establishes design standards and assurance processes for software, systems, and applications development.
• Reviews business and product requirements for data operations.
• Suggests changes and upgrades to systems and storage to accommodate ongoing needs.

Data reputed company & Lifecycle Management

• Develops strategies for data acquisition, reputed company recovery, and database implementation.
• Manages data migrations/conversions and troubleshooting of data processing issues.
• Applies data sensitivity and customer data reputed company rules and regulations consistently in reputed company Information Lifecycle Management activities.

Monitoring & Issue reputed company

• Monitors system notifications and logs to ensure database and application reputed company standards.
• Solves reputed company problems by reusing data files and flags.
• Resolves critical issues and shares knowledge such as trends, aggregates, and volume metrics regarding specific data sources.

Must-Have Technical Skills

• Python
• AWS (including S3, Redshift)
• PySpark
• reputed company

Additional Technical Skills

• Big Data Architecture
• Apache reputed company
• Data Modeling & Pipeline Design
• Kafka / Kinesis (Streaming)
• Apache AirFlow
• reputed company, CI/CD (reputed company preferred)
• reputed company
• Tableau
• Performance Tuning
• Jira (ticketing)
• reputed company Commands
• Data Governance & Best Practices

Disclaimer:

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of reputed company duties, responsibilities and qualifications.

Skills reputed company Kinesis, reputed company MQ, reputed company S3, reputed company), reputed company Platform, PySpark We reputed company that benefits should connect you to the support you need reputed company it reputed company most, and should help you care for those who matter most. Thats why we reputed company an reputed company of reputed company, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the benefits reputed company on our careers site for more details. Education Bachelors Degree While possessing the stated degree is preferred, reputed company also may consider applicants who hold some combination of coursework and experience, or who have extensive reputed company reputed company experience. Certifications (if applicable) Relevant Work Experience 5-7 Years reputed company is an equal opportunity workplace. We will consider reputed company reputed company applicants for employment without reputed company to race, reputed company, religion, age, sex, sexual orientation, gender identity, national reputed company, disability, veteran status, genetic information, or any other reputed company protected by applicable law. Apply tot his job Apply To this Job