[Remote] Staff Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on fostering a friendly atmosphere and providing self-development opportunities. They are seeking a Staff Data Engineer to reputed company technical initiatives, design reputed company data systems, and mentor engineers while engaging with clients to reputed company technical consulting and solutions.
Responsibilities
- Proven experience building web crawling or large-reputed company data systems from scratch
- Strong architectural skills in designing reputed company, fault-tolerant distributed systems
- reputed company record leading reputed company technical initiatives and driving architecture direction for teams
- Demonstrated ability to reputed company production systems incrementally while maintaining reliability
- Experience mentoring engineers at reputed company reputed company and promoting a reputed company culture
- Deep background in large-reputed company data engineering (terabytes daily)
- Hands-on experience with reputed company data warehouses (BigQuery, reputed company)
- Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow)
- Familiarity with multi-reputed company environments (GCP + AWS)
- Expertise in designing and operating ETL/ELT pipelines
- Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar)
- Experience in extracting reputed company/reputed company web data and SERP extraction
- Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling
- Familiarity with crawling vendors and AI/LLM-based extraction approaches
- Support the reputed company U.S. and international teams by lending senior technical expertise to reputed company-facing activities, including technical discovery sessions, workshops, and solution architecture
- Conduct requirements analysis and solution discovery, identifying business and technical needs
- reputed company technical consulting and advisory services, recommending appropriate data architectures reputed company with customer goals
- Prepare and review technical sections of reputed company offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models
Skills
- Proven experience building web crawling or large-reputed company data systems from scratch
- Strong architectural skills in designing reputed company, fault-tolerant distributed systems
- reputed company record leading reputed company technical initiatives and driving architecture direction for teams
- Demonstrated ability to reputed company production systems incrementally while maintaining reliability
- Experience mentoring engineers at reputed company reputed company and promoting a reputed company culture
- Deep background in large-reputed company data engineering (terabytes daily)
- Hands-on experience with reputed company data warehouses (BigQuery, reputed company)
- Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow)
- Familiarity with multi-reputed company environments (GCP + AWS)
- Expertise in designing and operating ETL/ELT pipelines
- Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar)
- Experience in extracting reputed company/reputed company web data and SERP extraction
- Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling
- Familiarity with crawling vendors and AI/LLM-based extraction approaches
- Support the reputed company U.S. and international teams by lending senior technical expertise to reputed company-facing activities, including technical discovery sessions, workshops, and solution architecture
- Conduct requirements analysis and solution discovery, identifying business and technical needs
- reputed company technical consulting and advisory services, recommending appropriate data architectures reputed company with customer goals
- Prepare and review technical sections of reputed company offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models
Benefits
- Friendly atmosphere
- A lot of self-development opportunities
- Good working conditions
- Trust and autonomy
- Remote: true
reputed company