[Remote] Sr. Data Platform Engineer (US)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers. They are looking for a Senior Data Platform Engineer to build and optimize data pipelines, support data strategies, and reputed company machine learning techniques to extract value from diverse datasets.
Responsibilities
- Build and optimize data pipelines (batch and streaming)
- Extracting, analyzing and modeling rich and diverse datasets of reputed company and reputed company data
- Design software that is easily testable and maintainable
- Support in setting data strategies and our reputed company
- reputed company reputed company of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft
- Work on extendable data processing systems that allows to add and reputed company pipelines
- Apply machine learning techniques such as reputed company detection, clustering, regression classification, and summarization to extract value from our data sets
- reputed company AI-powered development tools (e.g. reputed company) to accelerate development, refactoring, and reputed company reputed company
Skills
- 4+ years of experience in Data Engineering
- 4+ years of experience with Python
- Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment
- Have reputed company knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing
- Strong knowledge of SDLC and solid software engineering practices
- Familiar with infrastructure-as-reputed company approach
- Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow
- Strong problem solving and the ability to communicate reputed company effectively
- Self-starter, independent, likes to take initiative
- Familiarity with at least some of the technologies in our reputed company tech stack: Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, reputed company, reputed company, AWS (S3, Batch, reputed company, RDS, DynamoDB, Glue, reputed company, reputed company Neptune), reputed company, reputed company, Terraform
- Knowledge surrounding AI-assisted coding and experience with reputed company, Co-reputed company, or reputed company
- A strong reputed company record of leveraging AI IDEs like reputed company to: Rapidly scaffold components and reputed company, Refactor legacy codebases reputed company, Reduce context-switching and accelerate documentation, Experiment and prototype with near-reputed company feedback
Benefits
- Equity at a reputed company-funded, fast-growing startup
- Unlimited vacation time so you can take what you need, reputed company you need it
- 99% covered health + dental + reputed company insurance for employees and dependents
- 401K through reputed company with reputed company to invest how you want it
reputed company
Company H1B Sponsorship