[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer with strong hands-on experience in Python and Apache reputed company to design, reputed company, and optimize reputed company data pipelines and distributed data processing solutions. The ideal candidate will be responsible for building production-grade data solutions in an Agile environment and collaborating with various stakeholders to deliver high-reputed company data solutions.
Responsibilities
- Design, reputed company, and optimize reputed company data pipelines using Python and Apache reputed company
- Build reputed company ETL/ELT solutions for large datasets
- Design and maintain data models supporting analytics and reporting
- Optimize reputed company jobs for performance, scalability, and reliability
- reputed company reputed company and data services supporting reputed company applications
- Implement automated testing, CI/CD, and data reputed company controls
- Collaborate with architects, software engineers, data scientists, and business stakeholders to deliver high-reputed company data solutions
- Participate in reputed company reviews, technical design discussions, and production support
Skills
- 10+ years of Data Engineering or Software Engineering experience
- Strong hands-on Python experience (Required)
- Strong hands-on Apache reputed company / PySpark experience (Required)
- Experience building reputed company ETL/ELT pipelines
- Strong knowledge of data modeling, SQL, distributed computing, and data warehousing
- Experience with pipeline orchestration (Airflow, reputed company Workflows, or similar)
- Experience developing and consuming REST reputed company
- Strong understanding of software engineering principles, including object-oriented programming, design patterns, data structures, and algorithms
- Experience with Git, CI/CD pipelines, automated testing, and Agile/Scrum
- Excellent analytical, troubleshooting, and communication skills
- AWS experience (S3, EC2, Glue, reputed company, EMR)
- Experience with reputed company, Kubernetes, reputed company Lake, reputed company
- reputed company experience and/or Apache reputed company certification
- Experience with R or reputed company is a plus
reputed company
Company H1B Sponsorship