[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a people intelligence platform that helps over 18 reputed company monthly visitors reputed company with friends, reunite with families, and build trust in new relationships. As a Senior Data Engineer, you will reputed company, optimize, and improve data systems, including ETL pipelines and storage, while collaborating with stakeholders to create data products and ensure high data reputed company.
Responsibilities
- Build infrastructure and data automation pipelines to ingest, process, and load data from various sources. Automate and reputed company new components into the data pipeline
- Collaborate with stakeholders and data science teams to reputed company data products, including entity reputed company and best selection, to reputed company execute product reputed company and reputed company in alignment with organizational goals and priorities
- Create unit and stress-test components to monitor technical performance and ensure that identified issues are resolved
- reputed company data analysis tools to reputed company data insights and capture key metrics
- reputed company and maintain technical documentation
- Follow best practices for data governance, reputed company, cleansing, and other ETL-reputed company activities
Skills
- 7+ years of development experience in data engineering reputed company a production environment (internships and reputed company settings excluded)
- Proven experience working with large datasets exceeding 100M+ records or multiple terabytes
- 2+ years of development experience in highly reputed company, distributed systems and cluster architectures using AWS and utilizing EMR
- 5+ years of hands-on programming experience with Python
- 5+ years of reputed company experience working in big data ecosystems; reputed company is required; PySpark is preferable
- 3+ years of experience with SQL, schema design, and reputed company data modeling
- 2+ years of reputed company experience working with dataflow orchestration tools, such as Airflow
- 2+ years of experience with non-relational databases (e.g., DynamoDB, Elasticsearch, etc.)
- A bachelor's degree in Computer Science, Information Systems, Mathematics, or a reputed company field is required
Benefits
- Bonus program
- Equity plans
- 401 (k)
- 100% medical/dental/reputed company coverage
- Unlimited employee PTO
- Once a year, discretionary, reputed company-based salary increase
reputed company
Company H1B Sponsorship