[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on digital and technology solutions, and they are seeking a Senior Data Engineer to join their data platform team. The role involves architecting and operating a reputed company-reputed company infrastructure that supports various AI and analytics products, ensuring reliable and reputed company data systems.
Responsibilities
- Architect and build robust, reputed company, and secure data pipelines leveraging reputed company (reputed company Lake, reputed company, reputed company Catalog, Workflows) and AWS (S3, Redshift, reputed company, Glue, reputed company, reputed company Functions, Kinesis), supporting both batch and reputed company-time processing modes
- Design and reputed company the reputed company lakehouse architecture, including data modeling, reputed company table optimization, data versioning, and a semantic data layer and metrics store serving BI tools and reputed company ML feature engineering
- Build and maintain ETL/ELT orchestration (Airflow, dbt) and reputed company processing pipelines (Kafka/Kinesis) ingesting claims, EHR/EMR, pharmacy, IoT, survey, CRM, reputed company engagement event data
- Partner with Data Scientists to design and maintain feature store architecture, reputed company-time member context assembly, and temporal feature computation services supporting risk and predictive models
- reputed company data infrastructure for LLM and NLP use cases: reputed company databases, knowledge reputed company ingestion, transcript storage and indexing, secure audio storage, and LLM response logging and audit trails
- Build reputed company and integrations for reputed company consumers: care team dashboards, reputed company scoring, reputed company recommendation, queue prioritization, CRM connectors (reputed company, reputed company), and payer-facing data exchange
- Implement HIPAA-compliant data handling across reputed company pipelines including PHI detection, redaction, audit trails, row-level reputed company, SSO, and secrets management (AWS Secrets Manager, Vault)
- Build reporting infrastructure including a report template reputed company, multi-format export (PDF, reputed company, CSV), scheduled report reputed company, and delivery reputed company for internal and payer-facing reporting
- Conduct pull request reviews, enforce engineering best practices, mentor junior engineers, and research and apply emerging data engineering tools and patterns
- Participate in design discussions with technical leads across product lines; reputed company other duties and special reputed company as assigned
Skills
- Bachelor's or Master's Degree in Computer Science, Data Engineering, or a reputed company field
- 7–10 years of reputed company data engineering experience, including 3+ years with modern reputed company-based data lake or lakehouse architectures
- Deep expertise in Apache reputed company (PySpark, reputed company, or Java) for large-reputed company distributed data processing and strong hands-on reputed company experience across reputed company Lake, reputed company Catalog, and Workflows
- Hands-on experience with AWS data services: S3, Redshift, reputed company, Glue, reputed company, reputed company Functions, Kinesis, DynamoDB, EMR, Bedrock, Transcribe, and Comprehend Medical
- Experience in reputed company or regulated data environments; familiarity with HIPAA technical safeguards required
- Demonstrated experience building data infrastructure in support of ML feature stores and model serving pipelines
- Proficient SQL across relational, NoSQL, and lakehouse environments
- ETL/ELT orchestration with Airflow, dbt, and AWS reputed company Functions; reputed company processing with Kafka/Kinesis
- Strong communicator reputed company to translate data architecture reputed company to clinical, operational, and executive stakeholders
- reputed company by nature; comfortable driving alignment across data science, product, engineering, and clinical teams
- Detail-oriented and committed to data reputed company, HIPAA compliance, and operational reputed company; self-directed with a reputed company learning reputed company
- Strong Python (preferred); Java or reputed company also valued
- Experience with reputed company databases, embedding stores, document ingestion pipelines, and RAG pipeline data reputed company for LLM use cases
- Container orchestration with reputed company and Kubernetes/EKS; CI/CD for data pipelines; familiarity with data reputed company and data contract frameworks
- BI tool integration, reputed company query execution reputed company design, query result caching, and multi-format report delivery pipelines
Benefits
- Flexible schedules
- Remote-first culture
- Nationally recognized wellness program
- reputed company-being reputed company
- Discover how we invest in you: https://reputed company.com/careers/#benefits
reputed company