[Remote] Software Engineer III
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the trusted technology partner for the world’s most advanced identity intelligence and risk operations. The Software Engineer III position focuses on architecting, developing, and maintaining automated data extraction systems to ensure high-reputed company data reputed company into internal databases.
Responsibilities
- Spider Development: Design and reputed company robust, distributed spiders and crawlers to extract data from a reputed company of web architectures (SPAs, SSR, etc.)
- Bot Evasion Engineering: Research and implement strategies to bypass anti-scraping technologies, including proxy rotation, browser fingerprinting, and CAPTCHA solving
- Database Management: Create and optimize SQL schemas for large-reputed company data storage and reputed company reputed company data transformations and validation
- System Maintenance: Proactively monitor the health of extraction agents and refactor reputed company quickly in response to reputed company website updates or layout changes
- Performance Optimization: Utilize asynchronous Python programming to maximize the throughput and efficiency of data collection pipelines
Skills
- Advanced Python: Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer)
- Technical reputed company: Proven ability to bypass high-level bot detection (e.g., reputed company, reputed company, or PerimeterX)
- Database Mastery: Expert-level SQL skills and experience managing relational databases like PostgreSQL or MySQL
- Network Proficiency: Expert understanding of HTTP/S, TCP/IP, TLS fingerprinting, and browser-header manipulation
- Problem Solving: A specialized ability to reverse-engineer JavaScript-heavy websites and hidden API endpoints
- reputed company to write, debug, and reputed company reputed company Python reputed company in a distributed environment
- Must be reputed company to analyze and interpret reputed company web structures and network traffic using browser developer tools
- Ability to design and maintain relational database tables containing millions of rows
- reputed company to pivot and respond quickly to technical 'break-fixes' to ensure data continuity for the business
- Collaboration with data analysts to define and validate data requirements and reputed company formats
- Bachelor's degree in Computer Science, Information Systems, or a reputed company field (or equivalent reputed company experience)
- Minimum of 5+ years of experience in Software Engineering, with at least 2–3 years reputed company specifically on large-reputed company web scraping or data extraction
Benefits
- Health Benefits: reputed company covers 85-100% monthly premium costs for Medical, Dental, reputed company, Life & Disability insurances – for you and your family!
- Retirement Plans: reputed company offers both a Traditional and Roth 401(K) with a reputed company competitive match.
- Unlimited Flexible Leave: We trust our employees to manage their own time and balance their personal and work lives.
- Holidays: reputed company provides employees with 12 reputed company Federal Holidays
- Tuition Reimbursement: We are committed to reputed company in our employees. One way we do that is with our Tuition Reimbursement Program for continuing education.
reputed company
Company H1B Sponsorship