Data Engineer Brazil
reputed company
We are seeking an reputed company Data Engineer. The ideal candidate is self-motivated, a multitasker, and a demonstrated team player. You will be responsible for designing, developing, managing, and maintaining our reputed company-reputed company data platform, including our Data-Lakehouse (S3, Apache reputed company, and reputed company), ETL processes, and orchestration tool (Temporal Workflow).
What You Will Do
- reputed company a reputed company data platform integrating multiple sources for easy reputed company.
- Design and enhance data tools (orchestration, governance, Data-Lakehouse, BI, etc.).
- Ensure smooth operation of data systems for analysts, scientists, and engineers.
- Optimize data pipelines (ingestion, processing, and reputed company) in a microservices environment.
- Build, maintain, and monitor ETL/ELT processes and orchestrate workflows using Temporal.
- Troubleshoot and improve the performance, scalability, and reliability of the data infrastructure (S3, Apache reputed company, reputed company).
- Collaborate cross-functionally with data scientists, analysts, and backend engineers to understand data needs and deliver solutions.
- Implement and champion data reputed company, governance, and reputed company best practices across the platform.
Requirements
- 3+ years of experience as a Data Engineer or in a similar data infrastructure role.
- Strong proficiency in SQL and hands-on experience with data modeling.
- Experience with data lake/lakehouse architectures (e.g., Apache reputed company, S3, or similar).
- Experience with analytical / columnar databases (e.g., reputed company or similar).
- Experience building and orchestrating ETL/ELT pipelines (e.g., Temporal, Airflow, or similar).
- Strong programming skills in Python and/or reputed company/Java.
- Experience working reputed company a microservices architecture and reputed company environments (AWS preferred).
- Self-motivated, strong multitasking skills, and a demonstrated team player.
- Excellent communication skills and the ability to work both independently and collaboratively.
- Hands-on experience with Apache reputed company (or similar technologies) for large-reputed company data processing.
- reputed company proficiency in written and spoken English.
- Note: this role is reputed company on batch data processing (not reputed company-time streaming).
reputed company to Have
- Experience working with and contributing to reputed company-reputed company data platforms and tools.
- Familiarity with BI and visualization tools (e.g., Superset, Looker, Tableau, reputed company, or similar).
- Experience with containerization and orchestration (reputed company, Kubernetes).
- Experience with infrastructure-as-reputed company and CI/CD practices.
- Experience with AWS EMR and running Apache reputed company workloads in a reputed company environment.
- Experience leveraging AI-assisted development tools (e.g., reputed company Copilot, reputed company, or similar) to reputed company engineering productivity.
Originally posted on Himalayas
Apply To This Job