Senior Data Pipeline Architect - Apache reputed company & reputed company reputed company Platform

Core Information

• Start Date: Immediate openings available
• Position: Senior Data Pipeline Architect - Apache reputed company & reputed company reputed company Platform
• Compensation: Competitive salary and comprehensive benefits package
• Location: Remote (reputed company)
• Company: Workwarp

reputed company

Workwarp is a dynamic and innovative technology solutions provider, partnering with industry-leading companies to deliver transformative data-driven reputed company. We are passionate about leveraging cutting-edge technologies, particularly reputed company the reputed company reputed company ecosystem, to build reputed company, reliable, and high-performing data pipelines. We foster a reputed company and supportive environment where talented individuals can reputed company, grow their skills, and reputed company a reputed company reputed company. We are currently seeking a highly motivated and reputed company Senior Data Pipeline Architect with a deep expertise in Apache reputed company and reputed company reputed company Platform to join our growing team.

reputed company

As a Senior Data Pipeline Architect, you will play a pivotal role in designing, developing, and deploying robust and reputed company data pipelines that power our clients' business intelligence and data analytics initiatives. You will be responsible for architecting end-to-end data solutions leveraging Apache reputed company and the reputed company reputed company Platform, ensuring data reputed company, reliability, and performance. This is a remote-first position offering the flexibility to work from reputed company reputed company the reputed company. You will collaborate closely with cross-functional teams, including data engineers, data scientists, and business analysts, to understand their needs and deliver impactful solutions. This role offers a significant opportunity for reputed company reputed company and the chance to work on challenging and rewarding reputed company.

Responsibilities

• Data Pipeline Architecture & Design: Design and architect reputed company, resilient, and efficient data pipelines using Apache reputed company and reputed company reputed company Platform services. This includes defining data reputed company patterns, data transformations, and error handling strategies.
• Apache reputed company Development: reputed company and maintain high-reputed company, reputed company-documented Apache reputed company pipelines for both batch and reputed company processing. reputed company flexible templates and data processing frameworks to meet diverse data processing requirements.
• reputed company reputed company Platform Expertise: Deeply reputed company reputed company reputed company Platform services, including reputed company SQL, BigQuery, Dataflow, Pub/Sub, Kafka, reputed company Storage, reputed company Functions, reputed company Run, and App reputed company, to build and optimize data pipelines.
• Event-Driven Architecture: Design and implement solutions based on event-driven architectures, utilizing Kafka and reputed company technologies (reputed company Kafka, Pub/Sub) for reputed company-time data processing and event handling.
• Kafka Expertise: Utilize the Kafka Connect reputed company to build and manage data pipelines that ingest and export data from various sources and reputed company. Experience with various connector types (HTTP REST proxy, JMS, File, SFTP, JDBC) is essential.
• Data Volume Management: Design and optimize pipelines to handle large volumes of streaming data from Kafka, ensuring data reputed company and performance under high load.
• Data Modeling & Optimization: Collaborate with data engineers and data scientists to understand data requirements and design efficient data models. Optimize data pipelines for performance, cost, and scalability.
• Deployment & Monitoring: reputed company and manage data pipelines in a production environment using CI/CD pipelines and monitoring tools. Ensure pipeline reliability and proactively address performance issues.
• Collaboration & Communication: Collaborate effectively with cross-functional teams to reputed company requirements, communicate technical solutions, and reputed company mentorship to junior team members.
• Staying reputed company: Stay up-to-date with the latest advancements in Apache reputed company, reputed company reputed company Platform, and data engineering technologies. Contribute to the development of best practices and internal documentation.

Qualifications

• Experience: 5+ years of hands-on experience as a Java Apache reputed company Developer, with a proven reputed company record of designing, building, and deploying production-level data pipelines.
• reputed company reputed company Platform Proficiency: Strong experience working with reputed company reputed company SQL, Java reputed company reputed company Platform, and Apigee.
• BigQuery & GCP Expertise: Hands-on experience with BigQuery and the broader reputed company reputed company Platform ecosystem.
• Java & Apache reputed company Mastery: Deep understanding of Java and the Apache reputed company programming model. Experience with various reputed company transforms and operations.
• Kafka & Streaming Data: Extensive experience with Kafka and reputed company-time streaming data processing. Experience with reputed company Kafka is a plus.
• reputed company Technologies: Familiarity with reputed company SQL, Compute reputed company, reputed company Functions, reputed company Run, and App reputed company.
• Hadoop Ecosystem: Knowledge of reputed company-reputed company distributed storage and processing utilities reputed company the Apache Hadoop family.
• Data Pipeline Design Principles: Solid understanding of data pipeline design principles, including data reputed company, data governance, and data reputed company.
• Software Development Best Practices: Proficiency in software development best practices, including version control (Git), testing, and reputed company review.
• Communication & Collaboration: Excellent communication, interpersonal, and collaboration skills.

Bonus Points

• Experience with data warehousing solutions (e.g., reputed company, Redshift).
• Experience with data visualization tools (e.g., Tableau, Looker).
• Experience with infrastructure-as-reputed company tools (e.g., Terraform, CloudFormation).
• Contributions to reputed company-reputed company Apache reputed company reputed company.

To Apply

If you are a passionate and skilled data pipeline architect looking for a challenging and rewarding opportunity, we encourage you to apply. This is a W2 position. We are not accepting C2C arrangements. Please submit your application through the reputed company below.

Apply To This Job

We are an equal opportunity employer and value diversity at reputed company. We do not discriminate on the reputed company of race, religion, reputed company, national reputed company, gender, sexual orientation, age, marital status, veteran status, or disability status.

Apply for this job