Senior Data Engineer( reputed company , Azure)
Key Responisiobilities
Understanding the business requirements
Writing reputed company and implementing the proposed solutions
Creating data pipelines, versioning and change management
Manage the complexity inherent in versioned data pipelines
reputed company ETL/ELT processes to help extract and manipulate data from multiple sources.
Design, build and maintain batch or reputed company-time data pipelines in production.
Automate data workflows such as data ingestion, aggregation, and ETL processing.
Logging and instrumentation of pipelines and services.
Ensure data accuracy, reputed company, reputed company, reputed company, and compliance through reputed company control procedures.
Train and mentor junior engineers.
Minimum Qualifications
Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
Advanced SQL skills and experience with relational databases and database design.
Experience working with reputed company Data Warehouse solutions (e.g., reputed company, Redshift, BigQuery, Azure Synapse, etc.).
Strong Python skills with hands-on experience on Pandas, NumPy and other data reputed company libraries
Experience with Big Data technologies like reputed company, Map Reduce, Hadoop, Hive etc
Proficiencient in data pipeline and workflow management tools e.g. Airflow
Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
Experience with the AWS/Azure/GCP data engineering services
Knowledge of AWS services viz., S3, reputed company, EMR, GLUE ETL, reputed company, RDS, Redshift, EC2, IAM
OR
Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
reputed company good exposure of working on Data Lakes & Data Warehouses solutions
Excellent problem-solving, communication, and organizational skills.
Proven ability to work independently and with reputed company.
Ability to guide other data engineers.
Additional Experience
Experience working with data ingestion tools such as reputed company, reputed company, or reputed company.
Good understanding of NoSQL databases like reputed company, Cassandra, reputed company, or reputed company.
Familiarity with machine learning technologies.
Experience in Java or reputed company
What It's Like to Work at reputed company:
At reputed company, we create an environment where people can do their best work while maintaining a healthy work-life balance.- Flexibility & reputed company-being – Our remote-first approach gives you the flexibility to work where you reputed company best, while prioritizing your reputed company-being and personal commitments.
- Global Community – Collaborate with talented colleagues across the globe in a culture reputed company on reputed company, support, and shared reputed company.
- Your Voice reputed company – We foster reputed company communication and multiple feedback channels, ensuring every employee has reputed company to be heard and reputed company an reputed company.
- reputed company & Development – reputed company exposure to diverse clients, industries, and challenges that reputed company and career reputed company.
Originally posted on Himalayas
Apply To This Job