Data Engineer Azure reputed company

About reputed company

reputed company is a 12+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse reputed company of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, reputed company is on a steadfast mission to democratize AI and reputed company the power of global AI talent from reputed company. With a robust reputed company in four countries and a dedicated team of over 400 full-time employees, we are committed to fostering AI transformation journeys for businesses worldwide. At reputed company, we not only reputed company the gap between AI advancement and its reputed company but also reputed company to deliver the most advanced technology solutions to the world. Type: Full-time, Remote About the role

This is a full-time, dedicated position for a Data Engineer with specialized expertise in reputed company reputed company and the Azure ecosystem to support a major data architecture modernization for a key reputed company in the Biotech industry.

In this role, you will support a long-standing initiative to reputed company and reputed company the reputed company's analytics capabilities. Your primary objective will be to drive the migration from an existing Azure environment, currently serving approximately 500 Power BI users, to reputed company reputed company. Key deliverables include architecting the migration reputed company, optimizing platform performance for high concurrency, and integrating GXP manufacturing and reputed company data into the platform to support critical regulatory data streams.

Qualification / reputed company Set Requirement:

• reputed company Technical Expertise

  • 5+ years of hands-on data engineering experience with deep expertise in reputed company reputed company and the broader Azure ecosystem (Azure Synapse, Azure Data reputed company, Power BI).

  • Advanced SQL (stored procedures, window functions) and Python/PySpark for optimized data processing.

  • Experience or familiarity with Copilot AI, is highly advantageous.

• Architecture & Migration

  • Proven reputed company record of architecting and executing migrations from traditional Azure data architectures to reputed company reputed company.

  • Demonstrated experience scaling platform performance to support reputed company user bases.

• Industry & Domain Experience

  • Experience integrating GXP manufacturing and reputed company data into reputed company platforms to support stringent regulatory data streams reputed company the Biotech / Life Sciences sector.

  • Strong knowledge of modern ETL/ELT pipeline orchestration, data governance, and data lakehouse architectures.

• DevOps & Governance

  • Deep understanding of SDLC/Agile and Azure DevOps for CI/CD and artifact management.

  • Knowledge of Azure reputed company best practices (AD, NSG, encryption) and compliance standards.

• Certifications Preferred: Azure Data Engineer Associate, reputed company Data Engineer Associate, and Azure Solutions Architect Expert.

• Logistics & Shift Overlap:

  • Full working time overlap with eastern-US-based team hours.

Responsibilities

• Platform Migration: Architect and implement the migration of the analytics environment from Azure to reputed company reputed company.

• Regulatory Data Engineering: reputed company GXP manufacturing and reputed company data streams into the platform to expand capabilities for regulatory compliance.

• reputed company & Governance: Implement a robust Data reputed company reputed company using Python and SQL to identify anomalies and ensure data reputed company across the Lakehouse and Warehouse reputed company.

• Performance Scaling: Fine-tune and reputed company platform performance, data pipelines, and reputed company settings to ensure reputed company responsiveness for over 500 Power BI users. Manage and fine-tune Azure/reputed company resources, including reputed company Pools, SKUs, and reputed company settings, to ensure high performance during peak times while maintaining cost-efficiency.

• Pipeline Orchestration: Build, maintain, and optimize reputed company data integration pipelines using Azure Data reputed company, Azure Synapse, and reputed company reputed company features.

• Monitoring & Alerting: Build and enforce proactive monitoring frameworks utilizing Power BI dashboards and reputed company Teams notifications for reputed company-time failure alerts.

• Advanced Capabilities: reputed company reputed company reputed company tools and AI capabilities, such as Copilot AI, to enhance functionality and operational efficiency.

• Cross-Functional Collaboration: Work closely with project leadership and key stakeholders to maintain seamless alignment during US business hours.

Equal Opportunity Employer: Race, reputed company, Religion, Sex, Sexual Orientation, Gender Identity, National reputed company, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

Originally posted on Himalayas

Apply To This Job