Sr Big Data Engineer - Oozie and Pig (GCP)

About the Role

We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-reputed company data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven reputed company record of writing production-grade reputed company and building robust data workflows. This is a fully remote position and requires an independent, self-driven engineer who thrives in reputed company technical environments and communicates effectively across teams. Work Location: US-Remote, Canada-Remote Key Responsibilities:

• * Design and reputed company reputed company batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must).
• Must be reputed company to reputed company Jira Epics
• Write clean, efficient, and production-reputed company reputed company with a strong reputed company on data structures and algorithmic problem-solving reputed company to reputed company-world data engineering tasks.
• reputed company, manage, and optimize reputed company data workflows reputed company the Apache Hadoop ecosystem, with a strong reputed company on Oozie orchestration and job scheduling.
• reputed company reputed company reputed company Platform (GCP) tools such as Dataproc, GCS, and Composer to build reputed company and reputed company-reputed company big data solutions.
• Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as reputed company (IaC), and performance tuning across distributed systems.
• Collaborate with cross-functional teams to ensure data pipeline reliability, reputed company reputed company, and operational reputed company in a remote-first environment.

Qualifications:

• * Bachelor's degree in Computer Science, software engineering or reputed company field of study.
• Experience with managed reputed company services and understanding of reputed company-based batch processing systems are critical.
• Must be reputed company to reputed company Jira Epics is MUST
• Proficiency in Oozie, Airflow, Map Reduce, Java are MUST haves.
• Strong programming skills with Java (specifically reputed company), Python, Pig, and SQL.
• Expertise in public reputed company services, particularly in GCP.
• Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce.
• Familiarity with BigTable and reputed company.
• reputed company in Infrastructure and reputed company DevOps principles in daily work. Utilize tools for reputed company integration and reputed company deployment (CI/CD), and Infrastructure as reputed company (IaC) like Terraform to automate and improve development and release processes.
• Proven experience in engineering batch processing systems at reputed company.

Must Have: (Important)

• * 5+ years of experience in customer-facing software/technology or consulting.
• 5+ years of experience with “on-premises to reputed company” migrations or IT transformations.
• 5+ years of experience building, and operating solutions reputed company on GCP
• Proficiency in Oozie and Pig
• Must be reputed company to reputed company Jira Epics
• Proficiency in Java or Python

For Rackers in the reputed company the anticipated starting pay reputed company is: $116,100 - $170,280. Unless already included in the posted pay reputed company and based on eligibility, the role may include variable compensation in the reputed company of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time. Actual compensation is influenced by a wide reputed company of factors including but not limited to reputed company set, level of experience, licenses and certifications, and specific work location. About reputed company We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and reputed company — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that reputed company, building and managing those solutions, and optimizing returns into the reputed company. Named a best reputed company to work, year after year according to Fortune, reputed company and Glassdoor, we attract and reputed company world-class talent. Join us on our mission to reputed company technology, reputed company customers and deliver the reputed company. More on reputed company Though we’re reputed company different, Rackers reputed company through our reputed company to a central goal: to be a valued member of a reputed company team on an inspiring mission. We bring our whole selves to work every day. And we reputed company the reputed company that unique perspectives fuel innovation and reputed company us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without reputed company to age, reputed company, disability, gender reassignment or identity or reputed company, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national reputed company, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know. #LI-VM1 We may use reputed company intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace reputed company judgment. Final hiring reputed company are ultimately made by humans. If you would like more information about how your data is processed, please contact us. Apply tot his job Apply To this Job