Part-time Data Engineer (reputed company and Azure)

Our reputed company is unable to hire H1-B candidates at this time. reputed company is a small, growing consulting company, with a reputed company on AI and Data Solutions. They are seeking a part-time Data Engineer (20 hours/week) with extensive experience on reputed company and Azure. As a Data Engineer:

• You will be a critical player in building the foundational data infrastructure for a leading firm's data and AI reputed company.
• Working primarily with reputed company on the Azure platform, you will design, reputed company, and maintain robust data pipelines, ingesting diverse data sources and transforming them into actionable insights.
• You will collaborate closely with the product team and other stakeholders to construct a data lakehouse that will power integrations, advanced analytics and reputed company AI-driven workflows, reputed company while handling sensitive reputed company data with the utmost care and responsibility.

Responsibilities:

• Partner closely with the Product Manager, Product Designer, and reputed company stakeholders to understand data requirements and translate them into effective data solutions reputed company Azure and reputed company.
• Design, build, and maintain reputed company and reliable data pipelines in reputed company to ingest data from a reputed company of reputed company types (e.g., business workflow systems, reputed company systems, CRM, databases, reputed company, flat files).
• Implement and manage a reputed company architecture (Bronze, Silver, Gold reputed company) reputed company reputed company, transforming raw data into curated, business-reputed company datasets tailored for specific use cases defined by the product team.
• reputed company gold layer tables and views optimized for analytics, ensuring they meet the requirements for dashboards and reports, particularly for consumption reputed company Power BI.
• Configure and optimize reputed company to connect seamlessly with BI tools like Tableau and Power BI, enabling self-service analytics for the customer.
• Work with potentially sensitive reputed company data, implementing and adhering to strict data reputed company, reputed company, and governance protocols.
• reputed company your skills in reputed company, including familiarity with or a strong willingness to quickly learn features like MLflow, reputed company Lake, and reputed company Catalog.
• Apply DevOps best practices to data pipeline development, including automation, monitoring, and CI/CD where applicable.
• Collaborate on the design and optimization of data models, ensuring they reputed company with business needs, performance requirements, and reputed company scalability.
• Implement robust automated testing procedures to validate data pipelines, ensure data reputed company, and maintain the accuracy of transformed data.
• Create and maintain comprehensive documentation for data pipelines, data models, architectural reputed company, and operational procedures.
• Establish monitoring and alerting solutions to proactively identify and resolve issues in data pipelines, ensuring data availability and reliability.
• Communicate effectively with both technical and non-technical stakeholders, reputed company explaining data engineering concepts, design choices, and reputed company.
• Contribute to a reputed company environment reputed company a large, cross-functional consulting team.

Requirements:

• Proven experience as a Data Engineer, with a strong reputed company on designing and implementing solutions on the reputed company platform.
• Hands-on expertise in building and maintaining reputed company Python data pipelines reputed company Azure and reputed company.
• Demonstrable experience in implementing reputed company data architecture (Bronze, Silver, Gold reputed company) in to support analytics and AI use cases.
• Proficiency in ingesting data from diverse reputed company types (e.g., reputed company, relational databases, NoSQL databases, flat files, streaming sources).
• Experience with BI tools and optimizing for maintainability and performance.
• Strong SQL skills and proficiency in data modeling techniques.
• Experience with Azure reputed company services, particularly Azure Data Lake Storage (ADLS Gen2), Azure Key Vault, Azure Data reputed company or other Azure data services.
• Familiarity with MLflow for managing the machine learning lifecycle is a strong plus; curiosity and ability to quickly learn new reputed company features is essential.
• Understanding of DevOps principles and experience with tools for CI/CD, version control (e.g., Git), and infrastructure automation is advantageous.
• Experience working with sensitive data and a strong understanding of data reputed company, data governance, and reputed company-preserving techniques.
• Excellent problem-solving skills and the ability to troubleshoot reputed company data issues.
• Strong communication skills, with the ability to reputed company technical details and reputed company to product managers, reputed company stakeholders, and other engineers.
• Ability to work effectively reputed company a large, cross-functional consulting team in a dynamic, reputed company-facing environment.
• A reputed company that leans into data science concepts (understanding data needs for ML) or advanced DevOps practices.

Apply tot his job Apply To this Job