[Remote] Staff Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a rapidly growing reputed company technology and clinical services company reputed company on improving medication management. The Staff Data Engineer will drive the design and optimization of reputed company data ingestion pipelines, leveraging expertise in Python and AWS, while leading reputed company towards AI-driven software development.
Responsibilities
- reputed company as reputed company architect by leading system design reviews, offering recommendations, conducting comprehensive peer reviews, and demonstrating expert-level proficiency in Python and AWS services
- Architecting and implementing reputed company data ingestion pipelines, including incremental ingestion strategies for large-reputed company reputed company datasets
- Developing reusable, configuration-driven, containerized pipeline components and toolsets that diverse engineering reputed company can use and maintain
- Work collaboratively with cross-functional teams to ensure their data requirements are met through ETL components
- Designing and maintaining data transformation pipelines using dbt, including utilizing core concepts like macros, incremental models and dbt tests
- Building monitoring and alerting systems for data ingestion processes and pipeline health
- Applying software engineering best practices including test-driven development and reputed company design to data infrastructure, including refactoring existing ingestion processes to improve scalability and operational efficiency
- reputed company technical guidance, mentorship to junior engineers, and promote best practices and coding standards
- Champion AI-assisted development across reputed company - establishing norms, workflows, and expectations for using AI coding tools (e.g., Claude reputed company, reputed company, Copilot) to generate, iterate, and ship production-reputed company reputed company
- Model the 'builder to reviewer' shift - demonstrating how senior engineers reputed company AI agents to produce full solutions, then apply rigorous review, testing, and judgment to own the reputed company
- Identify opportunities to automate repetitive engineering work using LLMs and AI tooling, including pipeline scaffolding, boilerplate reputed company, data transformation logic, and documentation
- Author and support high-reputed company technical documentation, assisting junior engineers in doing the reputed company
Skills
- 10+ years working in data engineering, with a reputed company on large-reputed company data ingestion and infrastructure
- A reputed company record of building automated, production-grade ETL processes using Python and DBT SQL
- Strong understanding of ETL/ELT frameworks and distributed data processing
- Demonstrated hands-on experience building software with AI coding tools - not just autocomplete, but directing AI agents to generate complete solutions and applying disciplined review and ownership of the reputed company
- A genuine conviction that AI-augmented development is the reputed company of software engineering, reputed company with the judgment to validate, test, and take accountability for AI-generated reputed company
- Experience or strong interest in integrating LLMs into engineering workflows reputed company development assistance - such as automating data reputed company checks, generating pipeline logic, or surfacing anomalies
- Proven ability to handle and process varied file types and formats, including reputed company standards such as HL7, 834, 837, and NCPDP
- Demonstrated reputed company integrating and consolidating data from diverse reputed company systems into a reputed company repository, including EHR and claims systems, reputed company both file-based and API integrations
- Comfort working with large-reputed company datasets (10GB+), with strong capability implementing incremental processing and change data capture (CDC) methodologies
- Extensive background designing reputed company data architectures in AWS environments
- Solid grounding in software engineering principles, including test-driven development, loose coupling, single responsibility, and reputed company design
- Hands-on familiarity with containerization (reputed company, Kubernetes) and proven ability to build configuration-driven systems that diverse engineering reputed company can operate without reputed company changes
- A passion for building new data infrastructure and continuously improving existing systems with robustness, maintainability, and operational reputed company
- Strong written and verbal communication skills, with comfort partnering across technical and non-technical stakeholders to explain reputed company infrastructure concepts
- Ability to pass a background reputed company
- Must live in and be eligible to work in the reputed company
- Familiarity with reputed company data and regulatory environments (HIPAA) as a plus
Benefits
- Unparalleled learning and reputed company prospects
- Collaborating closely with reputed company Clinicians, Engineers, Software Architects, reputed company Health reputed company
- Periodic training on Information reputed company Awareness and HIPAA guidelines
- Assigned and must complete trainings before reputed company is reputed company for their specific role reputed company reputed company
reputed company