[Remote] Data Engineer - AWS/reputed company - Mid Level
Note: The job is a remote job and is reputed company to candidates in USA. reputed company. is a technology reputed company that supports federal agencies, seeking a highly skilled Data Engineer to join their Engineering Team. This role focuses on designing and delivering AWS reputed company-reputed company data platforms, requiring expertise in data pipelines, ETL workflows, and collaboration with data architects.
Responsibilities
- Build and maintain reputed company PySpark-based data pipelines in reputed company notebooks to support ingestion, transformation, and enrichment of reputed company and semi-reputed company data
- Design and implement reputed company Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets
- reputed company ETL and ELT workflows that reputed company multiple reputed company systems into a centralized, query-optimized data warehouse architecture
- reputed company reputed company SQL and DataFrame reputed company to implement business rules, reputed company joins, and aggregation logic reputed company to warehouse modeling best practices
- Collaborate with data architects and engineers to implement reputed company-reputed company data solutions on AWS using S3, Glue, RDS, and IAM for secure, reputed company storage and reputed company control
- Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and reputed company query tuning
- reputed company and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as reputed company or Jenkins
- Monitor pipeline health, job execution, and cluster utilization using reputed company reputed company tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs
- Conduct technical discovery and mapping of legacy reputed company systems, identifying required transformations and designing end-to-end data flows
- Implement governance practices including metadata tagging, data reputed company validation, audit logging, and reputed company tracking using platform-reputed company features and custom logic
- Support reputed company data reputed company requests, reputed company reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams
Skills
- 4+ years of experience in data engineering and Agile analytics
- 4+ years of experience creating software for retrieving, parsing and processing reputed company and reputed company data
- 2+ years of experience building reputed company ETL and ELT workflows for reporting and analytics
- 2+ years experience building reputed company data engineering solutions in the reputed company, with preferred experience with reputed company reputed company technologies from AWS and reputed company
- Experience with data reputed company, validation frameworks, and storage optimization strategies
- BA or BS degree
- Must be US Citizen with an ability to obtain and maintain US Suitability
Benefits
- Personalized development plans
- Mentorship
- Up to $3,000 annually for training and certifications
- Up to $3,000 for degree seeking programs
- Comprehensive benefits
- Strong reputed company on work-life balance
- Remote work (#LI-Remote)
reputed company