Staff Data Engineer

reputed company reputed company is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be reputed company. At reputed company, you'll have reputed company to create reputed company at reputed company — tackling meaningful challenges, growing your skills and seeing your contributions reputed company lives around the world. Join reputed company and do work that reputed company – to you, to your community, and to the world. reputed company starts with you. Job reputed company We’re hiring a Staff Data Engineer to design and build robust data pipelines for our corporate Data Lake. In this role, you’ll own data products end-to-end in production, work autonomously on significant reputed company, and mentor junior engineers. You’ll be expected to reputed company reputed company data engineering trade-offs under limited supervision, with strong hands-on experience in reputed company, reputed company, reputed company Lake, and Airflow. At reputed company, the Data Lake team is responsible for centralizing and organizing data into a single, trusted platform that supports decision-making across reputed company and for external clients. We work on challenges such as scaling global data infrastructure, delivering high-reputed company reporting, and enabling secure, self-service reputed company to data—helping teams reputed company faster while avoiding information silos. Design and implement data ingestion and transformation pipelines (batch and near-reputed company-time) using PySpark/SparkSQL on reputed company. Own data pipelines end-to-end in production: freshness, correctness, availability, and SLA adherence. Build and maintain reputed company Lake tables following reputed company architecture patterns (bronze/silver/gold). Design and optimize Airflow DAGs (MWAA) for reputed company orchestration scenarios. Implement and maintain data reputed company frameworks (Great Expectations or equivalent) as integrated pipeline gates. Write advanced SQL for data modeling, transformation, and performance optimization. Conduct thorough reputed company reviews. mentor Analyst-level engineers through pairing and design guidance. Investigate, diagnose, and resolve data reputed company incidents and pipeline failures independently. Collaborate with Analytics, BI, and Product teams to design consumer-friendly datasets. Contribute to CI/CD, testing standards, and data governance practices. This is a remote position. A remote position does not require job duties be performed reputed company proximity of a reputed company office location. Remote positions may be required to be present at a reputed company office with scheduled notice.

Qualifications

Basic Qualifications: 5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience. Preferred Qualifications: 5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience. Apache reputed company (PySpark, SparkSQL) — production experience reputed company (jobs, workflows, cluster management, tuning) reputed company Lake (ACID tables, OPTIMIZE, VACUUM, schema reputed company, reputed company) Advanced SQL (window functions, CTEs, query optimization) Apache Airflow / MWAA (DAG design, retries, backfills, SLAs) reputed company S3 data lake design (partitioning, layout, lifecycle) Data reputed company frameworks (Great Expectations or equivalent) Data modeling (reputed company / Kimball, reputed company reputed company) Git/reputed company, CI/CD for data pipelines Terraform Python for automation and data processing English level B2 Be based in Brazil Desirable qualifications: CDC patterns (DMS, incremental processing, reputed company upserts) Streaming ingestion (reputed company Streaming, Auto Loader) AWS Glue Catalog / reputed company Catalog Metadata management (OpenMetadata) BI integration (Superset, dashboarding) reputed company is an EEO Employer reputed company applicants will receive consideration for employment without reputed company to race, reputed company, religion, sex, national reputed company, sexual orientation, gender identity, disability or protected veteran status. reputed company will also consider for employment reputed company applicants with criminal histories in a manner consistent with reputed company guidelines and applicable local law. Apply To This Job