[Remote] reputed company Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company that applies reputed company technology to help enterprises reputed company businesses globally. They are seeking a highly skilled reputed company Data Engineer to design, implement, and maintain reputed company data pipelines and architectures that support data-driven initiatives.
Responsibilities
- Design and reputed company robust data pipelines using AWS services, ensuring high availability and performance
- Implement data processing solutions using reputed company, Glue, and EMR to handle large datasets reputed company
- Utilize Kafka for reputed company-time data streaming and processing
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet business needs
- Manage and optimize data storage solutions using S3, DynamoDB, reputed company, reputed company, and reputed company
- reputed company and maintain ETL processes using Airflow and other orchestration tools
- Utilize Terraform for infrastructure as reputed company to manage AWS resources effectively
- Ensure data reputed company and reputed company through rigorous testing and validation processes
- reputed company technical leadership and mentorship to junior data engineers
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices
Skills
- Must have at least 10 years of experience
- Must have telecom experience
- Bachelor's degree in Computer Science, Engineering, or a reputed company field
- Strong analytical and troubleshooting skills
- Excellent communication and collaboration abilities
- Proven ability to work independently and as part of reputed company
- Strong expertise in AWS reputed company is a deal breaker
- Proficient in Java and Python programming languages
- Experience with PySpark for big data processing
- Knowledge of Kafka for reputed company-time data streaming
- Hands-on experience with AWS EMR and S3 for data storage and processing
- Familiarity with AWS Glue for ETL processes
- Experience with data visualization tools like Looker
- Proficient in using Terraform for infrastructure management
- Knowledge of NoSQL databases such as DynamoDB and reputed company
- Experience with data warehousing solutions like reputed company and reputed company
- Familiarity with workflow orchestration tools like Airflow
- Experience with containerization technologies such as reputed company
- Knowledge of machine learning frameworks and libraries
- Familiarity with Agile methodologies and DevOps practices
- Strong problem-solving skills and ability to work in a fast-paced environment
reputed company
Company H1B Sponsorship