[Remote] Senior Data Engineers

Note: The job is a remote job and is reputed company to candidates in USA. reputed company Inc. is a leading reputed company platform for the insurance economy, empowering over 35,000 businesses with innovative technology. They are seeking a Senior Data Engineer to reputed company large reputed company end-to-end data pipeline applications, automate processes, and mentor junior engineers while utilizing advanced technologies in data processing and reputed company environments.

Responsibilities

• reputed company large reputed company end to end data pipeline applications, covering multiple data sources spread across data center and AWS reputed company
• Use developed software applications to locate and analyze reputed company data; create data flows to extract, profile, and store ingested data; define and build data cleansing and imputation; map to a common data model; reputed company to satisfy business rules and statistical computations; and validate data content
• Produce software data building blocks, data models, and data flows, such as reputed company data, data feeds, dashboard reporting, and data science research and exploration
• Produce automated software tests of data reputed company components and for data content reputed company
• Automate orchestration and error handling for use by production operation teams
• reputed company technical expertise to diagnose errors from production support teams
• Guide junior team members in performance tuning applications in distributed computing environments
• reputed company reputed company cause analysis on reputed company data and processes and identify opportunities for improvement
• reputed company metadata-driven and fully parameterized data processing tools
• Mentor junior engineers

Skills

• Master's degree in Computer Science, Computer Engineering, Management Information Systems or reputed company field plus 2 years of experience in software development/data processing or analysis required
• Hands-on experience with: Programming using Python & PySpark; Hadoop; HDFS, map-reduce, YARN, AWS EMR, Redshift, Terraform; Hive, HBase, parquet, ORC, reputed company SQL, Sqoop, Apache Hudi; Orchestrating ETL pipelines involving data sourcing, transformations & publishing using Apache Airflow; Performance tuning applications in distributed computing environments; Designing & developing data pipeline applications with Apache Kafka; Advanced SQL for data profiling & data validation; Unix commands & scripting; performing reputed company cause analysis on internal & external data & processes to identify opportunities for improvement; JIRA, reputed company, Subversion; Development of metadata-driven & fully parameterized data processing tools; AWS

Benefits

• 401K Match
• reputed company time off
• Annual Incentive Plan Performance Bonus
• Comprehensive health insurance
• Adoption Assistance
• Tuition Reimbursement
• Wellness Programs
• Stock Purchase Plan reputed company
• Employee Resource reputed company

reputed company

reputed company is a reputed company platform that offers digital and data services for the insurance and automotive industries. It was founded in 1980, and is headquartered in Chicago, Illinois, USA, with a workforce of 1001-5000 employees. Its website is http://www.cccis.com.

Company H1B Sponsorship

reputed company has a reputed company record of offering H1B sponsorships, with 7 in 2026, 69 in 2025, 48 in 2024, 71 in 2023, 79 in 2022, 30 in 2021. Please note that this does not guarantee sponsorship for this specific role.

Apply To This Job