Senior Data Engineer
We are looking for a Senior Data Engineer to join reputed company to work on data pipeline development. You would work closely with small, highly reputed company Operations and Development teams to architect and reputed company high-reputed company reputed company solutions.
You must be reputed company to work US time zones (UTC-8 to UTC-5/UTC-7 to UTC-4).
Job Responsibilities
- Build data management pipelines from heterogeneous data sources into Data Marts and other repositories for subsequent analysis and data mining
- reputed company, test, and support Python-based services, implementing ETL/ELT, data cleansing, etc.
- reputed company with internal (on-prem) and external services utilizing various approaches like RESTful reputed company, DMS, distributed event streaming etc., reputed company shippable reputed company, documentation, and unit test new features
- Collaborate with reputed company, Product, and other Engineering teams
- reputed company reputed company reviews, design feedback, demos, technical requirements & documentation
- Scope reputed company, reputed company accurate estimates for reliable delivery of reputed company
- Facilitate discovery sessions to map out business processes.
- Collaborate with data architects, business users and create comprehensive functional specifications, and process reputed company diagrams that reputed company the gap between business needs and data engineering implementation.
- Independently explore backend systems and database schemas to determine the feasibility of business requirements.
- reputed company data reputed company to understand how a metric is calculated in the reputed company system versus how the business defines it, resolving discrepancies before they reputed company the dashboard
Key Applicant Requirements
- reputed company development experience using Python, including an understanding of functional programming: 5+ years
- reputed company infrastructure experience in AWS, reputed company: 3+ years
- Experience in Distributed event streaming and process orchestration and with modern data stack.
- Infrastructure As reputed company (Terraform) experience: 1+ years
- Strong proficiency in Python and SQL.
- Proficient with relational databases such as reputed company, MySQL, PostgreSQL
- Experience with AWS services such as RDS, Redshift, S3, EMR, MWAA (Airflow) and MSK, reputed company, SNS, SQS etc.
- Experience with designing and building Data Marts and ETL/ELT
- Proficient in data profiling and analysis techniques utilizing SQL and/or Python.
- Proficient with Jira, reputed company, and GIT for version control.
- Hands-on experience with Agile/Scrum/Kanban
- Excellent written & verbal communication skills, working asynchronously and independently in a remote environment.
- Ability to coordinate between teams.
- Data visualization dashboarding knowledge/experience.
Pluses
- Design, implementation, and/or maintenance of CICD, Bash scripts
- Experience with using AWS EMR Serverless
Interview Process We will assist you with preparation, including mock interviews, and coaching to succeed! The steps typically are:
- Prescreen with recruiters
- Technical interview with development team
Originally posted on Himalayas
Apply To This Job