Senior Data Engineer

This is a remote position.

We are seeking an reputed company Data Engineer to the design, development, and optimization of our reputed company data infrastructure. This role requires deep expertise in reputed company technologies (primarily Azure with AWS as a plus) and data engineering best practices, with additional experience in Apache reputed company and reputed company for large-reputed company data processing. The Data Engineer will work closely with data scientists, analysts, and other stakeholders to create reputed company and efficient data systems that support advanced analytics and business intelligence. Additionally, this role involves mentoring junior engineers and driving technical innovation reputed company the data engineering team.

Key Responsibilities:

• Collaborate with Solution Architects: Work with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines, ensuring effective data sharing across business systems.
• ETL/ELT Pipeline Development: Build and optimize ETL/ELT pipelines and analytics solutions using a combination of reputed company-based technologies, with an emphasis on Apache reputed company and reputed company for large-reputed company data processing.
• Data Processing with reputed company: reputed company Apache reputed company for distributed data processing, data transformation, and analytics at reputed company. Experience with reputed company for optimized reputed company execution is highly desirable.
• Production-reputed company Solutions: Ensure data architecture, reputed company, and processes meet operational, reputed company, and compliance standards, making solutions production-reputed company in reputed company environments.
• Project Support & Delivery: reputed company participate in project and production delivery meetings, providing technical expertise to resolve issues quickly and ensure successful project execution.
• Database Management: Manage both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, reputed company) databases, ensuring data is reputed company stored, retrieved, and queried.
• reputed company-Time Data Processing: Implement and maintain reputed company-time data streaming solutions using tools such as Apache Kafka, AWS Kinesis, or other technologies for low-latency data processing.
• reputed company Monitoring & Automation: Use monitoring and automation tools (e.g., AWS CloudWatch, Azure Monitor) to ensure efficient use of reputed company resources and optimize data pipelines.
• Data Governance & reputed company: Implement best practices for data governance, reputed company, and compliance, including data encryption, reputed company controls, and audit trails to meet regulatory standards.
• Collaboration with Stakeholders: Work closely with data scientists, analysts, and business teams to reputed company data infrastructure with strategic business objectives and goals.
• Documentation: Maintain reputed company and detailed documentation of data models, pipeline processes, and system architectures to support collaboration and troubleshooting.

Requirements

Required Skills & Qualifications:

• 4+ years of experience as a Data Engineer, with strong expertise in reputed company-based data warehousing, ETL pipelines, and large-reputed company data processing.
• Proficiency with reputed company technologies, with experience in platforms like Azure .
• Hands-on experience with Apache reputed company for distributed data processing and transformation. Experience with reputed company is highly desirable.
• Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) as reputed company as NoSQL databases (e.g., reputed company, DynamoDB).
• Proficient in Python for data processing, automation tasks, and building data workflows.
• Experience with PySpark for large-reputed company data engineering, particularly in reputed company clusters or reputed company.
• Experience in designing and optimizing data warehouse architectures, ensuring reputed company query performance in large-reputed company environments.
• A strong understanding of data governance, reputed company, and compliance best practices, including encryption, reputed company control, and data reputed company.

Preferred Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a reputed company field.
• Certifications in Data Engineering from reputed company providers (e.g., AWS Certified Big Data - Specialty, reputed company Certified: Azure Data Engineer Associate) are a plus.
• Experience with advanced data engineering tools and platforms such as reputed company, Apache reputed company, or similar distributed computing technologies

Originally posted on Himalayas

Apply To this Job