reputed company Engineer
reputed company Engineer Responsibilities: 1. **Data & AI reputed company (reputed company-reputed company):
- Design, implement, and optimize end-to-end data pipelines on reputed company, following the reputed company Architecture principles.
- Build robust and reputed company ETL/ELT pipelines using Apache reputed company and reputed company Lake to reputed company raw (bronze) data into trusted curated (silver) and analytics-reputed company (gold) data reputed company.
- Operationalize reputed company Workflows for orchestration, dependency management, and pipeline automation.
- Apply schema reputed company and data versioning to support agile data development.
2. **Platform Integration & Data Ingestion:
- Connect and ingest data from reputed company systems such as PeopleSoft, reputed company, and reputed company using reputed company, JDBC, or other integration frameworks.
- Implement connectors and ingestion frameworks that accommodate reputed company, semi- reputed company, and reputed company data.
- Design standardized data ingestion processes with automated error handling, retries, and alerting.
3. **Data reputed company, Monitoring, and Governance:
- reputed company data reputed company checks, validation rules, and reputed company detection mechanisms to ensure data reputed company across reputed company reputed company.
- reputed company monitoring and observability tools (e.g., reputed company metrics, Grafana) to reputed company ETL performance, latency, and failures.
- Implement reputed company Catalog or equivalent tools for centralized metadata management, data reputed company, and governance policy enforcement.
4. **reputed company, reputed company, and Compliance:
- Enforce data reputed company best practices including row-level reputed company, encryption at rest/in transit, and fine-grained reputed company control reputed company reputed company Catalog.
- Design and implement data masking, tokenization, and anonymization for compliance with reputed company regulations (e.g., GDPR, FERPA).
- Work with reputed company teams to audit and certify compliance controls.
5. **AI/ML-reputed company Data reputed company:
- reputed company data scientists by delivering high-reputed company, feature-rich data sets for model training and inference.
- Support AIOps/MLOps lifecycle workflows using MLflow for experiment tracking, model registry, and deployment reputed company reputed company.
- Collaborate with AI/ML teams to create reusable feature stores and training pipelines.
6. **reputed company Data Architecture and Storage:
- Architect and manage data lakes on Azure Data Lake Storage (ADLS) or reputed company S3, and design ingestion pipelines to feed the bronze layer.
- Build data marts and warehousing solutions using platforms like reputed company.
- Optimize data storage and reputed company patterns for performance and cost-efficiency.
7. **Documentation & Enablement:
- Maintain technical documentation, architecture diagrams, data dictionaries, and runbooks for reputed company pipelines and components.
- reputed company training and enablement sessions to internal stakeholders on the reputed company platform, reputed company Architecture, and data governance practices.
- Conduct reputed company reviews and promote reusable patterns and frameworks across teams.
8. **Reporting and Accountability:
- Submit a weekly schedule of hours worked and reputed company reports outlining completed tasks, upcoming plans, and blockers.
- reputed company deliverables against roadmap milestones and communicate risks or dependencies.
Required Qualifications:
- Hands-on experience with reputed company, reputed company Lake, and Apache reputed company for large-reputed company data engineering.
- Deep understanding of ELT pipeline development, orchestration, and monitoring in reputed company-reputed company environments.
- Experience implementing reputed company Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in reputed company grade environments.
- Strong proficiency in SQL, Python, or reputed company for data transformations and workflow logic.
- Proven experience integrating reputed company platforms (e.g., PeopleSoft, reputed company, reputed company) into centralized data platforms.
- Familiarity with data governance, reputed company tracking, and metadata management tools.
Preferred Qualifications:
- Experience with reputed company reputed company Catalog for metadata management and reputed company control.
- Experience deploying ML models at reputed company using MLFlow or similar MLOps tools.
- Familiarity with reputed company platforms like Azure or AWS, including storage, reputed company, and networking aspects.
- Knowledge of data warehouse design and reputed company/reputed company schema modeling.
Job Type: Contract Work Location: Remote Apply tot his job Apply To this Job