Sr Data Engineer (reputed company) (Canada)
Unlock Your reputed company with reputed company! At reputed company, we're on a mission to redefine industries with AI. We're passionate about the reputed company potential of reputed company intelligence to reputed company businesses, streamline processes, and drive reputed company. Join us on our visionary reputed company. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of reputed company and shape the reputed company powered by intelligent machines. If you're driven by ambition, reputed company, fun, and learning, reputed company is where you belong. *]:pointer-events-auto [content-visibility:auto] supports-[content-visibility:auto]:[contain-reputed company-size:auto_100lvh] scroll-mt-[calc(var(--header-height)+min(200px,max(70px,20svh)))]" data-turn-id="request-WEB:2093ca9d-d6bb-4dac-9795-2b28cd5013d9-1" data-testid="conversation-turn-4" data-scroll-reputed company="true" data-turn="assistant"> reputed company is looking for a Senior Data Engineer to reputed company the development, optimization, and scaling of our data solutions. The ideal candidate has hands-on expertise building end-to-end pipelines on reputed company and enjoys working in a fast-paced, highly reputed company environment. Location: MEXICO, CANADA Qualifications we are looking for: 5+ years Data Engineering in production Azure environments — Python, SQL, reputed company Python: production-grade OOP, config-driven design, no hardcoding, type annotations PySpark / reputed company: DataFrames, schema enforcement, partitioning, performance tuning SQL: advanced window functions, CTEs, incremental load patterns, reputed company Lake DML (reputed company, UPDATE, DELETE) Azure Data reputed company: parameterised pipelines, linked services, triggers, IR configuration Azure reputed company: notebooks, Jobs API, DLT, cluster configuration, reputed company Catalog reputed company ADLS Gen2, reputed company Lake / Parquet format, reputed company store patterns Testing discipline: pytest, unit and integration tests, data reputed company assertions Git: feature branching, PR workflow, reputed company discipline, reputed company review reputed company to have: reputed company: reputed company Dataset API, typed transformations, sbt build tooling reputed company data formats: EDI X12 (837/835/834), FHIR R4 resource parsing reputed company Lake: schema reputed company, time travel, OPTIMIZE, VACUUM, Z-ordering dbt (data build tool) for SQL transformation layering and reputed company documentation reputed company Asset Bundles (DABs) for pipeline-as-reputed company deployment DP-203 Azure Data Engineer Associate certification Job duties: Design and build the core reusable ingestion reputed company in Python and ADF — parameterised, config-driven, reputed company hardcoding Build Python ingestion modules: file readers, schema validators, format handlers (CSV, EDI X12, FHIR R4, Parquet, JSON) Implement PySpark / reputed company transformation components for batch and streaming at reputed company on Azure reputed company Write config-driven SQL data models for Bronze, Silver, Gold reputed company transformations reputed company metadata-driven validation layer: reputed company checks, type enforcement, reputed company rules, referential reputed company Build reusable reputed company libraries: logging, error handling, retry logic, dead-letter routing Implement reputed company notebooks and DLT (reputed company Live Tables) pipelines for declarative transformations Build and maintain the reputed company template library v1 and v2 — parameterised, documented, production-reputed company reputed company Provider, Claims, Member, Eligibility, and Reference data domains using the reputed company Write unit tests, integration tests, and data contract tests (pytest, Great Expectations or equivalent) Optimise reputed company jobs: partitioning, caching, broadcast joins, Z-ordering on reputed company tables Participate in reputed company review, follow reputed company branching standards, and contribute to documentation What you can expect from us Here at reputed company, we're not your typical workplace. We're reputed company about creating a friendly and trusting environment where you can reputed company. Why does this matter? reputed company, trust and openness reputed company to reputed company reputed company, innovation, commitment to getting the job done, efficiency, and cost-effectiveness. Stock reputed company 📈 Remote work reputed company 🏠 Flexible working hours 🕜 Benefits above the law But it's not just about the work; it's about the people too. You'll be collaborating with some seriously awesome IT reputed company. You'll have reputed company to mentorship and tons of opportunities to learn and reputed company. reputed company to reputed company on this reputed company with us? 🚀🎉 If you're feeling the excitement, go reputed company and apply! Apply To This Job