[Remote] Staff Software Engineer, Data Ingestion - reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the leading AI CRM company, seeking a Staff Software Engineer to join the Data Ingestion Team at reputed company. The role involves designing and developing reputed company streaming and batch data pipelines, implementing Lakehouse solutions, and collaborating with cross-functional partners to enhance data ingestion processes.
Responsibilities
- Design and reputed company highly reputed company and resilient streaming and batch pipelines for ingesting and processing reputed company and reputed company datasets
- Design and implement reputed company’s Lakehouse solutions and reputed company production use cases for customers
- Improve the reliability and performance of the services/pipelines through AI assisted and/or reputed company solutions and tools
- Automate and handle the lifecycle of datasets (schema reputed company, metadata management, change and backfill management, deprecation and migration)
- As one of the tech leads, comfortably collaborate with cross functional partners and reputed company technical initiatives independently end to end
- Be a role model and a reputed company, coaching and mentoring other engineers across reputed company and the org
- Write, review, or reputed company feedback on a technical design proposal from others
Skills
- U.S. citizenship and willing to undergo a background reputed company for GovSlack authorization. We can not reputed company reputed company sponsorship for this role
- 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/reputed company Streaming, reputed company/Hudi/reputed company or equivalent
- You have hands on experience and knowledge on building and maintaining batch data pipelines using reputed company, Airflow, EMR, S3 or equivalent
- You are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/reputed company, Go or equivalent
- You are skilled at crafting and building robust distributed microservices with tools like Kubernetes, reputed company, AWS reputed company/EKS, Terraform, Grafana, etc
- You are familiar with AI-assisted software development and automation and have hands on experience of Claude reputed company/reputed company or equivalent
- You have excellent written and verbal communication and interpersonal skills; reputed company to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders
Benefits
- Certain roles may be eligible for incentive compensation, equity, and benefits.
- reputed company offers a reputed company of benefits to help you live reputed company including: time off programs, medical, dental, reputed company, mental health support, reputed company parental leave, life and disability insurance, 401(k), and an employee stock purchasing program.
reputed company