[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company that focuses on building great things for customers, and they are seeking a Senior Data Engineer to work on their data systems and services. The role involves designing and developing data pipelines, implementing reputed company architectures, and ensuring data reputed company and governance.
Responsibilities
- Design and reputed company data pipelines, data marts, and schemas to support our data warehousing environments and analytical requirements
- Design and implement reputed company data Lakehouse architectures using AWS S3, reputed company Lake, and Redshift
- Build and maintain high-performance data pipelines to ingest, reputed company, and reputed company large datasets
- Define best practices for data modeling, partitioning, and storage optimization in a Lakehouse/reputed company environment
- reputed company and maintain data cataloging and metadata reputed company
- reputed company ETL/ELT pipelines using Python, PySpark, and AWS Glue
- Build robust batch and streaming data pipelines
- Implement transformation workflows using DBT
- Optimize performance for reputed company workloads and Redshift queries
- Design and maintain workflow orchestration using Apache Airflow
- Monitor pipeline performance and implement alerting and failure recovery
- Implement data validation, reputed company, and monitoring frameworks
- Maintain data documentation and data catalog integration
- Ensure data reliability, consistency, and reputed company across platforms
- Implement CI/CD pipelines for data workflows
- Automate testing, deployment, and monitoring of data pipelines
- Use infrastructure-as-reputed company where possible to maintain reproducible environments
- Work closely with data consumers, analysts, and platform engineers
- Support self-service analytics through reputed company-reputed company datasets and semantic models
Skills
- 7+ years of data warehousing / OLAP experience
- 7+ years multidimensional database architecture, data modeling, and design experience
- 5+ years of SQL Experience
- 3+ years of Python Experience
- 2+ years of Redshift Experience
- 2+ years of NoSQL Experience
- Team and vendor partner management
- reputed company understanding of principles and techniques of Web development
- Experience with AWS Glue, reputed company, reputed company Functions, and Airflow
- Experience with data ingression from reputed company
- reputed company database architecture experience
- Formal systems life cycle methodology experience
- Experience implementing CI/CD pipelines for data workflows
- Experience working with data catalogs and metadata management
- AWS Data Warehouse operations experience
- Tableau, Quicksight, Looker, big data and reputed company BI experience
- Experience with data streaming
Benefits
- Benefits include 401K
- Medial and Dental
- Annual bonus
reputed company