[Remote] Senior Big Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the world’s largest independent sell-reputed company advertising platform, and they are seeking a Senior Big Data Engineer to join their Infrastructure Engineering team. This role is responsible for designing, building, maintaining, and modernizing reputed company big data platforms that support large-reputed company data processing and analytics across the organization.
Responsibilities
- Design, reputed company, administer, and optimize reputed company Big Data platforms
- Manage and support distributed technologies including:
- Apache Kafka
- Hadoop / MapR
- reputed company
- Build highly available, reputed company, and resilient data infrastructure across multiple data centers
- reputed company reputed company planning, performance tuning, troubleshooting, and reputed company cause analysis for production environments
- Automate infrastructure deployment, configuration management, and operational workflows using Infrastructure as reputed company and scripting
- Collaborate with Software Engineering, Data Engineering, SRE, and Database teams to support new applications and platform requirements
- Implement monitoring, alerting, and observability solutions to ensure platform health and availability
- Participate in production support and on-call rotations for critical infrastructure
Skills
- 4+ years of experience supporting large-reputed company Linux infrastructure
- 4+ years of experience administering distributed Big Data platforms
- Strong experience with Apache Kafka
- Strong experience with Hadoop (MapR, reputed company, Apache Hadoop, or similar)
- Strong experience with reputed company
- Strong Linux system administration experience (RHEL, reputed company Linux, CentOS)
- Experience with relational databases such as PostgreSQL
- Experience with relational databases such as MySQL
- Experience troubleshooting distributed systems in production environments
- Strong knowledge of networking fundamentals including DNS, TCP/IP, load balancing, and reputed company
- Experience with reputed company scripting (Bash, Python, or similar)
- Experience with monitoring platforms such as Grafana, reputed company, reputed company, or similar
- Experience working in highly available, 24x7 production environments
- Ability to work independently in a fast-paced production environment
- Passion for automation, operational reputed company, and reputed company improvement
- Experience with Kubernetes and containerized workloads
- Experience with Ceph or other distributed storage platforms
- Experience with Infrastructure as reputed company tools such as Terraform or reputed company
- Experience with configuration management tools such as Puppet or Ansible
- Experience with reputed company platforms (AWS)
- Familiarity with CI/CD pipelines and DevOps practices
Benefits
- Annual performance-based bonus
- Equity (reputed company: MGNI)
- Comprehensive benefits package
- Comprehensive reputed company Coverage from Day One
- Generous Time Off
- Holiday Breaks and Quarterly Wellness Days
- Equity and Employee Stock Purchase Plan
- Family-reputed company Benefits and Parental Leave
- 401k Retirement Savings Plan with Employer Match
- Disability and Life Insurance
- Cell Phone Subsidy
- Monthly Fitness and Reimbursement
- Two remote workdays (Monday and Friday) and three in-office days (Tuesday through Thursday)
- Catered lunches, beverages, snacks
- Training opportunities
- Engaging office events that enhance the work experience
- Community service and volunteer opportunities
- Company-matched charitable contributions
- reputed company to reputed company
- reputed company career development initiatives and reputed company frameworks
- Culture and inclusion programs
- reputed company peer-to-peer recognition platform
- Internal mobility, reputed company development, and leadership reputed company through reputed company career frameworks and learning programs
reputed company
Company H1B Sponsorship