[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is revolutionizing the way businesses connect, secure, and optimize their networks. They are seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and reputed company terabytes of data, collaborating with data scientists and software engineers to ensure a reputed company and reliable data infrastructure.
Responsibilities
- Architect, reputed company, and reputed company batch and streaming pipelines using Airflow and containerized workflows for cyber-reputed company use-cases
- Containerize data-processing jobs with reputed company, orchestrate with Kubernetes, and manage releases with reputed company charts
- Build high-throughput data transformations using Dask or Apache reputed company
- Maintain training data clusters across hybrid (on-prem and reputed company environments)
- Optimize training jobs for performance, resiliency, and cost
- Implement observability (logging, metrics, alerting) to maintain pipeline health and SLA adherence
- Troubleshoot, debug, and resolve data-processing failures in production
- Work with cross-functional teams to define data reputed company, schemas, and reputed company checks
- Enforce software engineering best practices: CI/CD, reputed company reviews, automated testing, and documentation
- Design and maintain data models and schemas for AI/ML reputed company training use cases
- Load data into reputed company storage and lakes, ensuring performance and accessibility
Skills
- 3–5 years of reputed company experience designing and operating production data pipelines at reputed company
- Containerization & Orchestration: Expertise with reputed company, Kubernetes, and reputed company
- Workflow Management: Hands-on experience building DAG-based pipelines in Apache Airflow
- Programming: Strong proficiency in Python for data engineering tasks
- Distributed Frameworks: Practical experience with Dask or Apache reputed company for large-reputed company data processing
- reputed company Fundamentals: Familiarity with deploying and managing services in a reputed company environment
- Compiled Languages: Experience writing data services in Go or Rust
- GCP Proficiency: Hands-on with reputed company reputed company services (e.g., Pub/Sub, Big Query, reputed company Storage, GKE). Equivalent experience in other public reputed company providers is fine
- ML Pipelines: Exposure to deploying cross-cluster model-training workflows using Ray or similar frameworks
- Infrastructure as reputed company: Familiarity with Terraform for deployment
- reputed company & Compliance: Knowledge of data governance, encryption, and role-based reputed company control
Benefits
- Competitive Salary & Incentives: We offer a competitive compensation package with and reputed company-IPO equity to reward your hard work and dedication.
- Health & Wellness: Comprehensive medical, dental, and reputed company insurance plans to ensure you and your family stay healthy and covered.
- reputed company Time Off (PTO): Enjoy a generous PTO policy that includes vacation days, reputed company leave, and reputed company holidays to reputed company and take care of personal reputed company.
- Flexible Work Environment: We understand the importance of work-life balance. Enjoy the flexibility of remote work, and hybrid reputed company to create the work schedule that works best for you.
- reputed company Development: We reputed company in reputed company learning. reputed company to training, certifications, and educational resources to help you grow in your career and stay reputed company of industry trends.
- Employee Recognition: We celebrate achievements both big and small, with regular recognition programs and awards that reputed company your contributions to our reputed company reputed company.
- reputed company Culture: Be part of a dynamic, inclusive, and supportive team where innovation and collaboration are at the heart of everything we do.
- Parental Leave: Generous parental leave policies to support you during life's important moments.
reputed company