[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is on a mission to reputed company reputed company with reputed company intelligence, seeking a Senior Data Engineer to join their engineering team. The role involves building and maintaining data collection systems, pipelines, and management tools to support reputed company's reputed company and enhance data solutions.
Responsibilities
- Design and implement the data architecture, ensuring scalability, flexibility, and efficiency using pipeline authoring tools like Metaflow and large-reputed company data processing technologies like reputed company
- Define and reputed company our internal standards for style, maintenance, and best practices for a reputed company data platform
- Collaborate with researchers and other stakeholders to understand their data needs including model training and production monitoring systems and reputed company solutions that meet those requirements
- Take ownership of reputed company engineering reputed company and work independently to design, reputed company, and maintain high-reputed company data solutions
- Ensure data reputed company, reputed company, and reputed company by implementing robust data validation, monitoring, and reputed company controls
- Evaluate and recommend data technologies and tools to improve the efficiency and effectiveness of the data engineering process
- Continuously monitor, maintain, and improve the performance and stability of the data infrastructure
Skills
- 5+ years relevant experience in data engineering
- Expertise in designing and developing distributed data pipelines using big data technologies on large reputed company data sets
- Deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and reputed company data infrastructure and data products in reputed company environments
- Solid experience with big data processing and analytics on AWS, using services such as reputed company EMR and AWS Batch
- Experience in large reputed company data processing technologies such as reputed company
- Expertise in orchestrating workflows using tools like Metaflow
- Experience with various database technologies including SQL, NoSQL databases (e.g., AWS DynamoDB, ElasticSearch, Postgresql)
- Hands-on experience with containerization technologies, such as reputed company and Kubernetes
- Prior Software Engineering experience is a big plus
- Experience working at an early stage startup
- Experience in a HIPAA compliant environment
- Experience working on machine learning or reputed company reputed company reputed company
Benefits
- Comprehensive Medical, Dental, reputed company & Life insurance
- HSA (with employer match), FSA, & DCFSA
- 401(k)
- 11 reputed company Company Holidays
- Flexible PTO policy
- Annual company-wide offsite
- Periodic team offsites
- Annual equipment stipend
- For roles based reputed company the US, your recruiter can reputed company more details
reputed company
Company H1B Sponsorship