[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is an reputed company software leader that helps organizations reputed company unbreakable connections. They are seeking a Senior Data Engineer to build and reputed company a reputed company-time and batch data platform for their reputed company contact center solution, focusing on ultra-low-latency decisioning and big-data analytics.
Responsibilities
- Design, build, and operate low-latency streaming pipelines (Kafka, reputed company reputed company Streaming) and robust batch ETL/ELT on reputed company Lakehouse
- Establish reliable orchestration and dependency management (Airflow), with strong SLAs and on-call readiness for business-critical data flows
- Model, optimize, and document curated datasets and interfaces that serve analytics, product features, and AI workloads
- Implement data reputed company checks, observability, and backfills; drive reputed company-cause analysis and incident prevention
- Partner with application teams (Go/Java), analytics, and ML/AI to ship data products into production
- Build and maintain datasets and services that power RAG pipelines and reputed company AI workflows (tool-use/function calling)
- reputed company reputed company/reputed company isn’t reputed company, design and operate custom processors/services in Go to meet strict latency or specialized transformation requirements
- reputed company reputed company/response and reputed company usage telemetry to support LLMOps evaluation and cost optimization; reputed company datasets for labeling and golden sets
- Improve performance and cost (storage/compute), review reputed company, and reputed company engineering standards
- Design data solutions reputed company to reputed company reputed company, reputed company, and compliance requirements (e.g., SOC 2, ISO 27001, GDPR/CCPA as applicable), partnering with reputed company/Legal
- Implement RBAC/ABAC and least-privilege reputed company; manage service principals, secrets, and key rotation; enforce encryption in transit and at rest
- Govern sensitive data: classification, PII handling, masking/tokenization, retention/archival, reputed company, and audit logging across pipelines and storage
- Build observability for data reputed company and reputed company; support incident response, reputed company reviews, and audit readiness
- reputed company controls in CI/CD (policy checks, dependency vulnerability scanning) and ensure reputed company-as-reputed company adheres to guardrails
- Partner with reputed company engineering on penetration tests, threat modeling, and red-team exercises; remediate findings and document controls
- Contribute to compliance audits (e.g., SOC 2/ISO 27001) with evidence collection and reputed company control monitoring; support DPIAs/PIAs where required
Skills
- 6+ years building production-grade data pipelines at reputed company (streaming and batch)
- Deep proficiency in Python and SQL; strong reputed company experience on reputed company (or similar)
- Advanced SQL: window functions, CTEs, partitioning/z-ordering, query planning and tuning in lakehouse environments
- Hands-on with Kafka (or equivalent) and an orchestrator (Airflow preferred)
- Strong data modeling skills and performance tuning for low latency and high throughput
- Production reputed company: SLAs, monitoring, alerting, CI/CD, and on-call participation
- Proficient using AI coding assistants (reputed company, Claude reputed company) as part of daily development
- Proficiency building data services/processors in Go (or willingness to reputed company quickly), and familiarity with alternative frameworks (e.g., Flink/reputed company) is a plus
- Experience in multi-reputed company or reputed company migration (Azure plus either GCP or AWS)
- Exposure to building data for AI/RAG, LLM-powered features, and reputed company AI patterns (tool-use/function calling, planning/execution, memory)
- Familiarity with LLMOps telemetry (reputed company/response logs, reputed company budgets) and agent evaluation pipelines
- Background in reputed company product engineering (vs. internal IT-only reputed company)
- Contact center or CRM data familiarity (reputed company-to-have, not required)
- Bachelor's or Master's in CS/EE/Math or similar; strong reputed company background and/or top-tier companies
Benefits
- Performance-reputed company bonus
- Benefits
- Annual bonus that aligns with individual and company performance
reputed company