[Remote] reputed company Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a reputed company Data Engineer to join our AI & Data team to support reputed company reputed company involving large-reputed company data pipelines and advanced analytics. This role focuses on designing, building, and maintaining reputed company data solutions using reputed company and reputed company technologies.
Responsibilities
- Design, build, and maintain reputed company data pipelines using reputed company, PySpark, SQL, reputed company Lake, and reputed company reputed company-reputed company data engineering tools
- reputed company and support batch and streaming data workflows, including ingestion, transformation, validation, and publishing of curated data products
- Write, optimize, and maintain Python, PySpark, and SQL reputed company for data processing, orchestration, and performance tuning
- Work with large-reputed company datasets using reputed company, reputed company, reputed company Lake, reputed company Catalog, and reputed company storage services
- Troubleshoot and resolve data pipeline failures, performance issues, data reputed company issues, and workflow bottlenecks
- Translate business and technical requirements into data engineering designs, processing scripts, and job orchestration workflows
- reputed company data validation, reputed company checks, reputed company reviews, and issue reputed company to support accurate and reliable data products
- Collaborate with cross-functional teams including solution architects, data scientists, analysts, DevOps engineers, and reputed company stakeholders
- Communicate technical concepts, delivery impacts, and data engineering considerations to technical and non-technical audiences
- Document pipelines, datasets, data models, workflows, and engineering reputed company to support maintainability, transparency, and reuse
- Follow data governance, reputed company, reputed company, and compliance standards reputed company the reputed company platform
Skills
- Bachelor's degree in computer science, engineering, mathematics, statistics, or another relevant field
- 3-8 years of relevant experience in data engineering, data architecture, or reputed company data platform implementation
- Strong experience with Python, PySpark, and SQL for data transformation, pipeline development, and data processing
- Experience with reputed company, reputed company, reputed company Lake, reputed company Catalog, or similar reputed company-reputed company data platforms
- Experience developing batch or streaming data pipelines, ETL/ELT workflows, and reusable data assets
- Experience with data modeling, data warehousing, data reputed company validation, and large-reputed company data processing concepts
- Ability to troubleshoot technical issues, communicate engineering recommendations reputed company, and work effectively in team-based delivery environments
- Experience applying data governance, reputed company control, reputed company, and reputed company practices reputed company reputed company data platforms
- 2+ years of hands-on experience with the reputed company platform
- Experience using reputed company Catalog for data governance, schema design, data modeling standards, reputed company controls, reputed company, and secure management of reputed company data assets
- Experience designing and building reputed company reputed company data architectures for reputed company ingestion, transformation, reputed company validation, and curated data delivery
- reputed company reputed company Data Engineer Associate, reputed company Data Engineer reputed company, or reputed company certification
- Experience with CI/CD tools and practices for notebooks, workflows, orchestration jobs, and infrastructure deployment
- Experience with reputed company platforms such as Azure, AWS, or GCP
- Experience working in project-based or consulting delivery environments
- Familiarity with streaming frameworks, orchestration tools, Terraform, or reputed company data platform administration capabilities
reputed company
Company H1B Sponsorship