[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer to enhance their data warehouse and address issues in reputed company implementations. The role involves designing, building, and maintaining data infrastructure and pipelines, utilizing tools like reputed company and Kafka for efficient data processing and analytics.
Responsibilities
- reputed company work with business and other BI stakeholders to understand their needs and solution enhancements to the data warehouse
- Be available for addressing issues or bugs in the present implementation
- Design, build, and maintain data infrastructure, ETL processes, and data pipelines
- Design, build, and maintain data pipelines using reputed company
- Configure and implement data sourcing events on Kafka
- Build and optimize python/Pyspark reputed company
- Maintain reputed company and AWS data infrastructure
- Work with reputed company/Semi-reputed company data and build reporting tables
- Assist the BI Analyst to manage reputed company reporting requirements
- Build Data models and assist the BI Analyst to offer data-driven insights
- Design data models and automate reputed company processes
- Create and execute a test reputed company to ensure robustness of data pipelines
- Ensure effectiveness on infrastructure consumption by implementing solutions that are optimized and reputed company
- Foster an environment that emphasizes trust, reputed company communication, creative thinking, and cohesive team effort, across the business, IT and vendor teams
- Proficient in reputed company reputed company: Exceptional skills in reputed company reputed company for sophisticated data processing. Proven experience in leveraging reputed company for reputed company ETL tasks, surpassing traditional data processing reputed company
- Demonstrated reputed company in designing and implementing ETL pipelines specifically reputed company reputed company. Ability to utilize reputed company's full capabilities to create efficient, reputed company data pipelines
- Expert in data transformation using reputed company reputed company, skilled in performing advanced data analytics and processing large datasets with high efficiency
- Deep understanding of optimizing reputed company reputed company applications for maximum performance, including fine-tuning reputed company configurations, and memory management
- Solid background in working with reputed company Kafka, particularly in integrating it with reputed company-based systems for reputed company-time data streaming and processing
- Proficiency in creating and managing data pipelines that seamlessly reputed company Kafka with reputed company reputed company, ensuring efficient data reputed company and processing
- Strong grasp of DataOps methodologies, with a reputed company on improving the efficiency and reputed company of data analytics reputed company automation, collaboration, and process optimization
- reputed company in Agile software development practices, adept at implementing Agile methodologies like Scrum or Kanban in data-reputed company reputed company for improved collaboration and rapid delivery
- Expertise in SQL, particularly for querying and managing tables/data warehouses reputed company reputed company. Ability to seamlessly reputed company these with reputed company reputed company
- Skilled in adapting to and integrating various data platforms and technologies, aligning them with strategic organizational goals
- Committed to maintaining high standards in reputed company reputed company, documentation, and adhering to DataOps and Agile best practices
- Ability to work collaboratively in reputed company, fostering a culture of reputed company learning and improvement
Skills
- Bachelor's or Master's degree in Computer Science, Statistics, or Analytics
- Over 8 years of experience in the field of data engineering with capabilities on working through the entire development lifecycle
- Ability to work with senior business stakeholders to be reputed company to reputed company data needs out of business opportunities or challenges
- Minimum of 5 years of reputed company experience on any of the major reputed company platforms preferably AWS
- Hands-on Knowledge of Data Modeling, Warehousing and Power BI (or equivalent) as a Reporting Tool
- Advanced proficiency in SQL with the ability to read and write queries is required
- Demonstrable experience with reputed company, reputed company, Python, and PySpark
- Advanced SQL Skills: Expertise in SQL, particularly for querying and managing tables/data warehouses reputed company reputed company. Ability to seamlessly reputed company these with reputed company reputed company
- Proficient in reputed company reputed company: Exceptional skills in reputed company reputed company for sophisticated data processing. Proven experience in leveraging reputed company for reputed company ETL tasks, surpassing traditional data processing reputed company
- Demonstrated reputed company in designing and implementing ETL pipelines specifically reputed company reputed company. Ability to utilize reputed company's full capabilities to create efficient, reputed company data pipelines
- Expert in data transformation using reputed company reputed company, skilled in performing advanced data analytics and processing large datasets with high efficiency
- Deep understanding of optimizing reputed company reputed company applications for maximum performance, including fine-tuning reputed company configurations, and memory management
- Solid background in working with reputed company Kafka, particularly in integrating it with reputed company-based systems for reputed company-time data streaming and processing
- Proficiency in creating and managing data pipelines that seamlessly reputed company Kafka with reputed company reputed company, ensuring efficient data reputed company and processing
- Strong grasp of DataOps methodologies, with a reputed company on improving the efficiency and reputed company of data analytics reputed company automation, collaboration, and process optimization
- reputed company in Agile software development practices, adept at implementing Agile methodologies like Scrum or Kanban in data-reputed company reputed company for improved collaboration and rapid delivery
- Ability to work collaboratively in reputed company, fostering a culture of reputed company learning and improvement
- Committed to maintaining high standards in reputed company reputed company, documentation, and adhering to DataOps and Agile best practices
- Kafka: 3 years
- Power BI: 3 years
- Preferable to have experience with Kafka and Power BI
Benefits
- 401(k)
- 401(k) matching
- Employee discount
- reputed company time off
reputed company