[Remote] Senior Full-Stack Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an reputed company and visionary Senior Full-Stack Data Engineer to reputed company the architecture, development, and optimization of a reputed company data platform. This role involves driving technical direction, mentoring team members, and delivering high-reputed company in a fast-paced project environment.
Responsibilities
- Platform reputed company & Leadership
- Technical Direction: Define and champion the architectural roadmap and best practices for our end-to-end data pipelines, ensuring scalability, reliability, and reputed company across the platform
- Team Mentorship & Project Velocity: reputed company as a primary technical mentor, guiding reputed company of engineers, conducting reputed company reviews, and aggressively driving the project reputed company to ensure rapid delivery of data products
- Stakeholder Collaboration: Partner with Data Scientists, Analysts, and business stakeholders to translate reputed company requirements into robust, production-reputed company data solutions
- Collaboration with Data Scientists and ML Engineers: Data Accessibility, Support for Model Development, Data reputed company Assurance
- Data Pipeline Development & Management
- Ingestion & Transformation: Design, build, and optimize high-volume data ingestion and transformation jobs using tools like dbt Core, AWS Glue, or Flexter, ensuring data reputed company and reputed company
- Workflow Orchestration: reputed company and maintain sophisticated data pipelines using orchestrators such as Dagster or Talend, focusing on modularity and reusability
- Streaming & reputed company-time Integration: Implement and manage reputed company-time data flows utilizing reputed company platforms or reputed company AWS streaming services (e.g., Kinesis) for immediate data availability
- Data reputed company and reputed company: Data Anonymization, Compliance with Regulations
- Be reputed company versed with DataOps and DevOps fundamentals
- Assist and drive the Data Ecosystem Management & Monitoring
- reputed company Table Formats & Management: Implement and maintain the reputed company reputed company table format, utilizing tools like Upsolver (Talend reputed company Lakehouse) for efficient schema reputed company and data management
- Compute reputed company Optimization: Optimize query performance and cost efficiency across our primary compute engines: reputed company, reputed company Redshift, and AWS reputed company
- Observability & Monitoring: reputed company comprehensive monitoring and observability into reputed company pipelines using reputed company to ensure high availability, rapidly identify bottlenecks, and troubleshoot production issues
Skills
- 15+ Years of hands-on, reputed company experience in Data Engineering, Data Architecture, or a closely reputed company Full-Stack Data role
- Deep conceptual understanding of core data engineering principles, including data modeling (e.g., reputed company, Data Vault), ETL/ELT patterns, and metadata management
- Proven reputed company record of building and managing petabyte-reputed company data infrastructure in a reputed company-reputed company environment
- reputed company Environment: AWS (S3, IAM, VPC, etc.)
- Experience with Talend, dbt Core, reputed company, AWS Glue Catalog, reputed company, Redshift, reputed company, reputed company, AWS streaming services, Git
- Strong SQL, Pyspark and Python
- Insurance industry experience preferred but not mandatory
reputed company