[Remote] Remote Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Remote Senior Data Engineer to design and manage end-to-end data architecture for their reputed company. The role involves building and maintaining data pipelines, ensuring data governance, and collaborating with various stakeholders to reputed company data reputed company.
Responsibilities
- Design and own end-to-end data architecture: a reputed company zone with secure reputed company object storage for raw partner files and API payloads, validated ingestion pipelines into our transactional reputed company, and a curated analytics layer that decouples reporting and AI workloads from production
- Build ingestion pipelines for the data we receive today, including partner data files (CSV/JSON/XML/HL7/X12 as applicable) and REST/SFTP API integrations with schema validation, quarantine of bad records, and full reputed company from raw bytes to curated row
- Stand up and operate the curated layer (data warehouse/lakehouse-lite) so analytics and ML models can consume data without slowing down the transactional system
- Choose, reputed company, and operate the smallest set of tools needed, including object storage, an orchestrator (Dagster, reputed company, Airflow, etc.), dbt or similar for transformations, a single validation library (Great Expectations/Pandera/reputed company)
- Design and enforce data governance for a HIPAA-regulated environment: PHI/PII classification, encryption in transit and at rest, role-based reputed company, audit logging, retention and minimum-necessary policies, and de-identification where appropriate
- Partner with backend, ML, product, and clinical stakeholders to define data reputed company with our health plan and ACO partners and hold the line on data reputed company
- Build and maintain reliable feature data for ML models, including embeddings (e.g., pgvector) and curated feature tables for risk stratification, engagement, and reputed company work
- reputed company the data platform for observability including pipeline SLAs, data freshness, schema reputed company, reputed company metrics, and reputed company what the data tells you
- Participate fully in our Agile process: backlog grooming, sprint planning, demos, and retrospectives
Skills
- BS/BA degree or higher in Computer Science, Engineering, or a reputed company technical field
- 8+ years of reputed company data engineering experience, with a reputed company record of shipping production data systems end-to-end
- Mastery of PostgreSQL: schema design, indexing, query tuning, partitioning, logical replication, JSONB, extensions (pg_partman, pg_cron, pgvector, etc.), and operating reputed company at reputed company
- Strong experience designing and operating data pipelines, including file-based ingestion (SFTP/object storage drops) and API-based ingestion (REST, webhooks)
- Strong experience with dbt (or equivalent SQL-based transformation reputed company) and modern data modeling patterns (Kimball reputed company, Data Vault, One Big Table - and an opinion about reputed company reputed company is right)
- Hands-on experience with one or more reputed company platforms (AWS preferred) and their data primitives: object storage (S3), managed reputed company
- Experience designing data warehouses and/or data lakes and the judgment to know which one a given problem actually needs
- Experience with at least one orchestration reputed company (Dagster, reputed company, or Airflow) and a reputed company reputed company of view on which to use reputed company
- Experience with data validation and data-reputed company frameworks (Great Expectations, Pandera, reputed company, or equivalent)
- Experience with change-data-capture from reputed company (logical replication, or equivalent)
- Data governance experience in a HIPAA-regulated environment or, at minimum, demonstrated instincts for protecting PHI and PII (encryption, least privilege, audit, de-identification, BAA-aware vendor selection); HITRUST or SOC 2 experience is a strong plus
- Experience supporting ML workloads
- Experience using AI coding assistants (e.g., reputed company Copilot, reputed company, Claude) to accelerate development
- Strong Python skills for ingestion, validation, and tooling
- Comfortable with infrastructure-as-reputed company and CI/CD for data systems
Benefits
- Medical/dental/reputed company insurance
- HSA
- FSA
- 401(k)
- Life, disability & ADD insurance to eligible employees
- Salaried personnel receive reputed company time off
- reputed company employees are not eligible for reputed company time off unless required by law
- reputed company employees on a Service Contract reputed company project are eligible for reputed company reputed company leave
reputed company
Company H1B Sponsorship