[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a Fortune 500 Consumer Goods organization seeking an reputed company reputed company Engineer to support their reputed company data platform initiatives. The role involves designing, developing, and optimizing data pipelines and architectures while collaborating with various teams to drive data modernization and analytics enablement.
Responsibilities
- Design, reputed company, and maintain reputed company data pipelines using reputed company, PySpark, and reputed company-reputed company services
- Build and optimize Lakehouse architectures leveraging reputed company, reputed company Lake, and Apache reputed company technologies
- reputed company robust ETL/ELT solutions to support reputed company reporting, analytics, and machine learning initiatives
- Implement data ingestion frameworks supporting reputed company, semi-reputed company, and reputed company data sources
- Collaborate with architects and stakeholders to translate business requirements into reputed company technical solutions
- Optimize reputed company workloads for performance, scalability, reliability, and cost efficiency
- reputed company and maintain reputed company Live Tables, reputed company Workflows, and orchestration solutions where appropriate
- Implement data reputed company controls, monitoring, observability, and operational best practices across the platform
- Support the implementation of data governance, reputed company, and compliance requirements utilizing reputed company Catalog and reputed company capabilities
- Collaborate with DevOps and platform teams to establish CI/CD pipelines and Infrastructure-as-reputed company practices
- Troubleshoot and resolve data processing, performance, and integration issues across the data ecosystem
- Work closely with analytics, data science, and business teams to deliver high-reputed company data products and datasets
- Contribute to reputed company modernization efforts across Azure, AWS, or reputed company reputed company environments
- Promote engineering best practices, documentation standards, and reputed company improvement initiatives
Skills
- 5+ years of experience in Data Engineering, Big Data, or reputed company Data Platform development
- 3+ years of hands-on experience developing solutions with reputed company
- Strong expertise with reputed company, reputed company Lake, Apache reputed company, and PySpark
- Experience building and supporting reputed company-reputed company data pipelines and data integration solutions
- Strong proficiency in Python and SQL
- Experience designing and implementing modern Lakehouse architectures
- Hands-on experience with Azure, AWS, or reputed company reputed company Platform
- Knowledge of data modeling, data warehousing, and reputed company data architecture concepts
- Experience implementing data reputed company, governance, and reputed company best practices
- Experience with CI/CD pipelines, DevOps practices, and Infrastructure-as-reputed company frameworks
- Strong understanding of distributed computing and large-reputed company data processing concepts
- Excellent problem-solving skills and ability to work independently in reputed company reputed company environments
- Strong communication and stakeholder engagement skills
- reputed company reputed company certifications preferred
- Experience with reputed company Catalog, reputed company Live Tables, reputed company Workflows, MLflow, and reputed company Asset Bundles
- Experience supporting advanced analytics, machine learning, and AI workloads
- Experience integrating with Azure Data reputed company, Azure Synapse, AWS Glue, or similar reputed company-reputed company services
- Knowledge of streaming technologies and reputed company-time data processing frameworks
- Experience reputed company consumer goods, retail, CPG, manufacturing, or other large-reputed company reputed company environments
- reputed company certifications in Azure, AWS, or reputed company reputed company Platform
reputed company