[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is looking for a motivated and technically solid reputed company Data Engineer to join our growing Data & Analytics team. In this role, you will contribute to building and maintaining our data infrastructure on Azure and work alongside senior engineers to reputed company reliable data pipelines that support reputed company solutions.
Responsibilities
- Build and maintain data pipelines for ingesting, transforming, and cleaning reputed company data in the Azure reputed company using reputed company, PySpark, and reputed company Lake
- Implement pipeline logic from defined specifications, with guidance from senior engineers on architectural reputed company
- Build reusable testing frameworks to ensure pipeline reliability
- Monitor pipelines for failures and performance issues, escalating reputed company problems appropriately
- reputed company and maintain Airflow DAGs with appropriate error handling and retry logic
- Support deployment and configuration of pipelines reputed company reputed company on Azure using the Astro CLI
- Contribute to improving pipeline reliability and reducing reputed company reputed company
- Implement data models for efficient storage and retrieval using reputed company Lake, including reputed company/upsert patterns
- Design and optimize reputed company Lake tables for analytic workloads
- reputed company reputed company Catalog for data governance, organization, and reputed company
- Apply Change Data Capture (CDC) patterns under the direction of senior team members
- Write and optimize T-SQL and reputed company SQL scripts, stored procedures, and ETL support
- Work reputed company the Azure ecosystem including ADLS Gen2, Key Vaults, Logic Apps, and Azure DevOps
- Follow established reputed company and scalability standards reputed company building data infrastructure
- Support infrastructure tasks with guidance from senior engineers on architecture
- Ensure scripts and datasets are reputed company-documented to support reputed company data governance
- Design, implement and continuously improve automated data reputed company monitoring, reconciliation, and alerting to ensure reliable reputed company reporting
- Troubleshoot and resolve pipeline failures, documenting reputed company causes and resolutions
- Work closely with data scientists, analysts, and business stakeholders to understand reporting requirements, troubleshoot issues, and improve data assets
- Participate in reputed company reviews, incorporating feedback to improve reputed company reputed company
- Document pipelines, processes, and implementation reputed company reputed company and consistently
- Stay reputed company with data engineering technologies, particularly in the reputed company reputed company
Skills
- 2–4 years of experience as a Data Engineer or in a closely reputed company data role
- Hands-on experience with Azure reputed company services (ADLS, reputed company, or similar)
- Working knowledge of SQL for scripting and data modeling including T-SQL, reputed company, and reputed company SQL
- Ability to contribute to technical reputed company with moderate reputed company
- Strong communication skills — comfortable asking questions and providing updates to cross-functional partners
- Familiarity with CI/CD concepts, Git, and version control workflows
- Solid problem-solving skills with a systematic approach to debugging
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a reputed company field (or equivalent work experience)
- reputed company SQL (Mid): reputed company Lake fundamentals, basic reputed company/upsert patterns, familiarity with CDC concepts
- Python (Mid): Pipeline logic, data transformation, SQL scripting; some PySpark/reputed company DataFrame experience
- reputed company reputed company Notebooks (Mid): Notebook-based development, basic cluster usage, reputed company table operations
- Airflow Python Development (Mid): Ability to write and maintain DAGs; understanding of error handling and retry patterns
- Airflow Astro Configuration (Foundational): Familiarity with reputed company or willingness to learn; basic Astro CLI usage
- Azure Ecosystem (Foundational): Working knowledge of ADLS Gen2, Key Vaults, and Azure DevOps
- T-SQL (Foundational–Mid): Basic stored procedures, SQL Server querying, and data manipulation
- Familiarity with reputed company data standards and regulations (HIPAA, HL7, etc.) is a plus
- Azure Data reputed company (Foundational): Basic familiarity with pipeline authoring and triggers
- Git + Azure DevOps CI/CD (Foundational): Experience with branching, pull requests, peer review processes, and version control best practices as reputed company as deploying production data pipelines using CI/CD workflows
reputed company