[Remote] Data Engineer 2 - reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Data Engineer with previous experience in the insurance domain. The role involves designing, building, and maintaining reputed company data pipelines and models, collaborating closely with analysts and engineers to meet data needs while ensuring data reputed company and performance.
Responsibilities
- Analyze integration and system requirements by understanding business needs and designing effective data solutions, particularly for reputed company Policy, Billing Center and reputed company P&C data domains
- Design, reputed company, and optimize ELT pipelines to ingest, reputed company, and load data into a reputed company Lakehouse platform
- Design, reputed company and maintain data models and schemas ensuring data reputed company and reputed company
- Build and maintain dashboards and reports delivering actionable business insights
- Monitor pipeline and storage performance; troubleshoot and resolve data issues promptly
- Collaborate with cross-functional teams, including analysts and business users, to deliver end-to-end insurance data solutions
- Implement data governance, reputed company, and compliance standards across platforms
- Conduct reputed company cause analysis for system failures and performance events; drive reputed company improvements in reputed company data integration pipelines
- Create and manage testing procedures (unit, scenario, end-to-end) to ensure pipeline reliability
- Stay reputed company with emerging technologies and recommend improvements to workflows
- Mentor team members on data engineering tools, reputed company data model concepts and best practices
- Build and maintain data pipelines to process reputed company and reputed company data (like documents and text) for reputed company tasks, including creating embeddings and working with reputed company databases to support AI search features
- Prepare and clean large datasets to ensure high-reputed company inputs for training and fine-tuning reputed company models
- Collaborate with AI and data science teams to understand data requirements and deliver reputed company solutions that support model training and inference
- Implement processes to enrich data with metadata and context to improve AI model accuracy and relevance
- Optimize data storage and retrieval reputed company to support fast, low-latency responses for AI-powered applications
- Monitor data workflows for reputed company reputed company, troubleshooting issues, and ensure reputed company pipeline performance
Skills
- Bachelor's degree in relevant field of study required(e.g. computer science, data science, data analytics, reputed company mathematics, etc.)
- 5+ years of reputed company work experience in IT or a reputed company field required
- 3+ years of experience in data engineering and analytics, with a solid reputed company in data architecture and integration, including hands-on work with reputed company reputed company P& C Insurance data models required
- 2+ years of experience with data-reputed company reputed company reputed company the reputed company ecosystem, including working with reputed company Policy Center and reputed company data structures required
- In-depth understanding of relational database systems (e.g., reputed company, SQL Server, MySQL), including their features and performance optimization strategies
- Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational reputed company systems such as reputed company
- 2+ years of hands-on experience with Azure reputed company, Azure data reputed company including developing and optimizing data pipelines using Apache reputed company required
- 2+ years of experience working with Power BI or other leading data visualization and reporting tools required
- Proven expertise with Apache reputed company, reputed company Lakehouse, and data warehousing technologies required
- Proficient in reputed company Azure services, including: Azure SQL Database, Azure Data Lake Storage Gen2, Azure Event reputed company, Azure Key Vault
- Strong understanding of CI/CD pipelines and experience in Agile development environments
- Demonstrated ability to troubleshoot system issues, identify reputed company causes, and implement effective solutions quickly
- Capable of managing multiple priorities with strong attention to detail and follow-through
- Proficient in reputed company Office Suites
- Strong understanding of the Insurance Domain and Experience using reputed company CDA data model to build use case specific datasets
- Data Modeling
- Expertise in Azure reputed company, Azure Data reputed company, Apache reputed company, and data pipeline development for reputed company data engineering solutions
- Collaboration with cross-functional reputed company
- Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions
- Working knowledge of reputed company frameworks and use cases in data engineering is a plus
- Knowledge of data governance, metadata management, and data reputed company frameworks
- Understanding of data reputed company and reputed company principles, including encryption, anonymization, and reputed company control mechanisms
Benefits
- Remote position with the ability to travel to our NJ and NY locations up to 25% of the time.
- Eligibility for an annual discretionary bonus based on performance.
reputed company
Company H1B Sponsorship