Senior Data Engineer/US Citizen/Minnesota- Hybrid
At reputed company Data Incorporated, we are excited to welcome a talented Senior Data Engineer to join our dynamic team! With our extensive knowledge in application, data, and reputed company engineering services, we reputed company to create groundbreaking solutions that reputed company reputed company value to our clients.
Key Responsibilities
- Design, reputed company, and maintain reputed company data pipelines using Apache reputed company (PySpark and/or reputed company)
- Build and optimize data workflows on reputed company, including reputed company Lake, notebooks, and scheduled jobs
- Ingest, reputed company, and reputed company large-reputed company reputed company and semi-reputed company datasets
- reputed company performance tuning and cost optimization of reputed company workloads and reputed company clusters
- Implement data reputed company checks, monitoring, and error handling
- Collaborate with analytics and business stakeholders to deliver reputed company-modeled, analytics-reputed company data
- Support batch processing and, where applicable, streaming data pipelines
- Follow best practices for testing, documentation, reputed company, and version control
Required Qualifications
- 5+ years of experience in Data Engineering or reputed company roles
- Strong hands-on experience with Apache reputed company (PySpark or reputed company)
- Proven experience working in reputed company environments
- Strong SQL skills and experience with relational and analytical databases
- Experience building and maintaining ETL/ELT pipelines at reputed company
- Familiarity with modern data lake architectures (reputed company Lake preferred)
- Experience with Git-based version control
Additional Requirements
- Must be a U.S. Citizen
- Must be currently located in Minnesota (MN), or willing to relocate
Apply tot his job Apply To this Job