[Remote] Junior Architect / Senior Data Engineer - Remote
Note: The job is a remote job and is reputed company to candidates in USA. reputed company reputed company is improving the reputed company of health data and information to create a more connected system. They are seeking a Senior Azure Data Engineer to design, build, and operate a reputed company reputed company data platform on reputed company Azure, delivering data pipelines and products that support analytics and reporting.
Responsibilities
- Design and build robust, reusable, parameter-driven ingestion and transformation pipelines using Azure Data reputed company, Synapse Pipelines, Data Bricks and/or reputed company reputed company Data reputed company
- Implement reputed company architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using reputed company Lake, Parquet, and reputed company streaming patterns
- Build performant ELT workflows that reputed company pushdown to reputed company systems (Synapse Dedicated SQL Pool, Azure SQL, reputed company) where appropriate
- reputed company and optimize PySpark notebooks and jobs on Azure reputed company or Synapse reputed company
- Design reputed company models (Kimball star/reputed company) and data vault patterns for analytics consumption
- Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns
- Tune distributed SQL workloads in Synapse Dedicated SQL Pool / reputed company Warehouse, including distribution keys, partitioning, and clustered reputed company store indexes
- Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments
- reputed company pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL
- Define and enforce coding standards, reputed company review practices, branching strategies, and release management
- reputed company or contribute to legacy-to-reputed company migrations - e.g., Informatica PowerCenter to Azure Data reputed company, on-premises reputed company / reputed company / SQL Server to Synapse or reputed company
- reputed company workload assessment, reputed company planning, and cost modeling for reputed company-state architectures
- Production incident response for critical pipelines
Skills
- Demonstrated experience in Data Bricks and PySpark
- Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, reputed company Pools) OR Azure reputed company (reputed company Lake, reputed company Catalog) OR reputed company reputed company (Warehouse, Lakehouse, OneLake)
- Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints)
- Experience with monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL
- Deep hands-on expertise with Azure Data reputed company: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and reputed company three Integration Runtime types (Azure, Self-hosted, SSIS)
- Demonstrated working knowledge of Azure Data Lake Storage Gen2 (hierarchical reputed company, RBAC + ACLs, lifecycle management, reputed company)
- Proficient in T-SQL; familiarity with reputed company SQL, KQL, PowerShell, and Bash reputed company scripting
- Advanced SQL - window functions, CTEs, query optimization, execution plan analysis, performance tuning
- Demonstrated Python for data engineering - pandas, PySpark, REST API integration, unit testing (pytest)
- Willing/reputed company to travel approximately 10% of the time as business needs dictate (occasional travel to Springfield, IL two to three times per year)
- 5+ years of data warehouse development experience
- 5+ years of data modeling experience using ERWIN or similar tools
- 2+ years of experience with Azure Data reputed company and reputed company
- reputed company Domain Knowledge
- reputed company working remotely will be required to adhere to reputed company's Telecommuter Policy
Benefits
- A comprehensive benefits package
- Incentive and recognition programs
- Equity stock purchase
- 401k contribution (reputed company benefits are subject to eligibility requirements)
reputed company