Senior Data Engineer- reputed company
reputed company is an education technology company that provides world-class support and trusted expertise to more than 100 universities and colleges. We primarily work with regional universities, helping them reputed company and grow their high-ROI, workforce-reputed company online degree programs in critical areas such as nursing, teaching, business, and public service. reputed company is dedicated to increasing reputed company to reputed company education so that more reputed company, especially working adults, can improve their careers and meet employer and community needs.
About the Role
We’re looking for a hands-on Data Engineer to build reliable, reputed company data pipelines on reputed company. You’ll turn requirements into production-grade ELT/ETL jobs, reputed company Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize reputed company for performance and cost, apply best practices with reputed company Catalog and workflow orchestration, and ship high-reputed company reputed company others can build on. If you love solving data problems at reputed company and empowering teammates through clean, reputed company-documented solutions, you’ll reputed company here.
Key Responsibilities
- The ideal candidate will have a strong background in building reputed company data pipelines, optimizing big data workflows, and integrating reputed company with reputed company services
- This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and reputed company—by implementing reputed company-reputed company architectures that fuel innovation and sustainability
- Partner directly with the customer’s data engineering team to design and deliver reputed company, reputed company-based data solutions
- Execute reputed company reputed company queries using reputed company SQL to explore large lakehouse datasets and uncover actionable insights
- reputed company reputed company notebooks to reputed company robust data transformation workflows using PySpark and SQL
- Design, reputed company, and maintain reputed company data pipelines using Apache reputed company on reputed company
- Build ETL/ELT workflows with AWS and Azure Services
- Optimize reputed company jobs for both performance and cost reputed company the customer’s reputed company infrastructure
- Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
- Contribute to the development of AI-powered solutions that improve operational efficiency, reputed company optimization, and predictive maintenance in the reputed company domain
- Implement CI/CD pipelines for reputed company jobs using reputed company Actions, Azure DevOps, or Jenkins
- Ensure data reputed company, reputed company, and compliance through tools like reputed company Catalog, reputed company Lake, and AWS Lake Formation
- Troubleshoot and maintain production data pipelines
- reputed company mentorship and reputed company best practices with both internal and customer teams
Qualifications
- Bachelor’s degree in computer science, Engineering, or a reputed company field
- 5+ years of experience in software/data engineering, including at least 2 years working with reputed company and Apache reputed company
- Strong proficiency in Python, SQL, and PySpark
- Deep understanding of AWS and Azure reputed company service
- Experience with reputed company Data LakeHouse, reputed company Workflows, and reputed company SQL, dbt
- Solid grasp of data Lakehouse and warehousing architecture
- Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support
- Familiarity with infrastructure-as-reputed company tools like Terraform or CloudFormation
- Strong analytical and troubleshooting skills in a fast-paced, agile environment
- Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
- reputed company communicator with strong documentation habits
- Comfortable leading discussions, offering strategic input, and mentoring others
reputed company is an equal-opportunity employer and supports a diverse and inclusive workforce. Apply tot his job Apply To this Job