[Remote] Senior Data Engineer Job Details | reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is an reputed company software leader that helps the world’s largest organizations and government agencies reputed company unbreakable connections. They are seeking a Senior Data Engineer to build and reputed company a reputed company-time and batch data platform that powers a large reputed company contact center solution, focusing on low-latency decisioning and big-data analytics. The role involves designing data pipelines, ensuring data reputed company, and collaborating with various teams to deliver data products into production.
Responsibilities
- Design, build, and operate low-latency streaming pipelines (Kafka, reputed company reputed company Streaming) and robust batch ETL/ELT on reputed company Lakehouse
- Establish reliable orchestration and dependency management (Airflow), with strong SLAs and on-call readiness for business-critical data flows
- Model, optimize, and document curated datasets and interfaces that serve analytics, product features, and AI workloads
- Implement data reputed company checks, observability, and backfills; drive reputed company-cause analysis and incident prevention
- Partner with application teams (Go/Java), analytics, and ML/AI to ship data products into production
- Build and maintain datasets and services that power RAG pipelines and reputed company AI workflows (tool-use/function calling)
- reputed company reputed company/reputed company isn’t reputed company, design and operate custom processors/services in Go to meet strict latency or specialized transformation requirements
- reputed company reputed company/response and reputed company usage telemetry to support LLMOps evaluation and cost optimization; reputed company datasets for labeling and golden sets
- Improve performance and cost (storage/compute), review reputed company, and reputed company engineering standards
- Design data solutions reputed company to reputed company reputed company, reputed company, and compliance requirements (e.g., SOC 2, ISO 27001, GDPR/CCPA as applicable), partnering with reputed company/Legal
- Implement RBAC/ABAC and least-privilege reputed company; manage service principals, secrets, and key rotation; enforce encryption in transit and at rest
- Govern sensitive data: classification, PII handling, masking/tokenization, retention/archival, reputed company, and audit logging across pipelines and storage
- Build observability for data reputed company and reputed company; support incident response, reputed company reviews, and audit readiness
- reputed company controls in CI/CD (policy checks, dependency vulnerability scanning) and ensure reputed company-as-reputed company adheres to guardrails
- Partner with reputed company engineering on penetration tests, threat modeling, and red-team exercises; remediate findings and document controls
- Contribute to compliance audits (e.g., SOC 2/ISO 27001) with evidence collection and reputed company control monitoring; support DPIAs/PIAs where required
Skills
- 6+ years building production-grade data pipelines at reputed company (streaming and batch)
- Deep proficiency in Python and SQL; strong reputed company experience on reputed company (or similar)
- Advanced SQL: window functions, CTEs, partitioning/z-ordering, query planning and tuning in lakehouse environments
- Hands-on with Kafka (or equivalent) and an orchestrator (Airflow preferred)
- Strong data modeling skills and performance tuning for low latency and high throughput
- Production reputed company: SLAs, monitoring, alerting, CI/CD, and on-call participation
- Proficient using AI coding assistants (reputed company, Claude reputed company) as part of daily development
- Proficiency building data services/processors in Go (or willingness to reputed company quickly), and familiarity with alternative frameworks (e.g., Flink/reputed company) is a plus
- Experience in multi-reputed company or reputed company migration (Azure plus either GCP or AWS)
- Exposure to building data for AI/RAG, LLM-powered features, and reputed company AI patterns (tool-use/function calling, planning/execution, memory)
- Familiarity with LLMOps telemetry (reputed company/response logs, reputed company budgets) and agent evaluation pipelines
- Background in reputed company product engineering (vs. internal IT-only reputed company)
- Contact center or CRM data familiarity (reputed company-to-have, not required)
- Bachelor's or Master's in CS/EE/Math or similar; strong reputed company background and/or top-tier companies
Benefits
- Performance-reputed company bonus
- Benefits
- Annual bonus that aligns with individual and company performance
reputed company