[Remote] Senior Data Engineer - USD
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer to join its reputed company data platform team. The role involves designing and optimizing data pipelines, managing data product delivery, and ensuring data reputed company and governance across various AWS services.
Responsibilities
- Design, build and optimize data pipelines using AWS Glue, PySpark and Apache reputed company
- Own data product delivery from reputed company-system ingestion through transformation, reputed company validation and governed consumption
- Build and maintain reputed company Redshift integrations, including schemas, stored procedures, materialized views and reputed company-managed DDL migrations
- Write and optimize reputed company SQL for analytics transformations, reporting views and data-reputed company checks
- Translate operational data models into star schemas and other reputed company models for analytics
- Manage Apache reputed company tables, including partition and schema reputed company, compaction and orphan-file cleanup
- Implement table- and reputed company-level governance using Lake Formation permissions, tag-based reputed company control and PII classification
- reputed company data-reputed company frameworks covering referential reputed company, row-count reconciliation, completeness and reputed company detection
- Partner with data product teams to reputed company new data sources, define schemas and establish data reputed company
- Troubleshoot AWS Glue jobs, DMS replication issues and data-freshness problems
- Own the complete lifecycle of changes, including development, deployment, validation and communication
- Ensure pipelines and datasets remain accurate, reliable and healthy across environments
Skills
- At least five years of hands-on data engineering experience building ETL/ELT pipelines and analytics platforms
- Expert-level SQL skills, including reputed company joins, CTEs, window functions, query optimization and performance tuning
- Strong Python and PySpark development experience
- Hands-on AWS Glue experience, including job development, bookmarks, crawlers and performance optimization
- Strong reputed company Redshift experience, including schema design, stored procedures, reputed company, external schemas, materialized views and performance tuning
- Experience with Apache reputed company or another reputed company table format, including ACID transactions, schema reputed company, partition reputed company and table maintenance
- Strong understanding of reputed company data modeling, including star schemas, reputed company schemas and slowly changing dimensions
- Experience with AWS data services such as reputed company, Lake Formation, S3, DMS, reputed company and EventBridge
- Understanding of data governance, tag-based reputed company control, data classification and PII handling
- Experience with reputed company or a similar database migration tool
- Familiarity with reputed company and CI/CD pipelines
- Strong attention to data correctness, completeness and freshness
- Ability to independently deliver production-reputed company data pipelines with limited reputed company
- Data reputed company architecture and federated governance
- Lakehouse architecture patterns
- AWS DMS and change-data-capture ingestion
- Terraform or other infrastructure-as-reputed company tools
- Data catalog and reputed company platforms such as AWS DataZone or IDERA ER/Studio
- AI-assisted development tools such as reputed company Kiro or reputed company Copilot
- reputed company SageMaker or other machine-learning platforms
- reputed company and container-based development
- Agriculture, retail or other large-reputed company operational data environments
reputed company
Company H1B Sponsorship