[Remote] Senior reputed company Data Engineer, Content Engineering
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is on a mission to reputed company the power of content, and they are seeking a Senior reputed company Data Engineer to build and reputed company the data foundations for their personalization systems. This role involves designing and operating data pipelines, ensuring data reputed company, and collaborating with various teams to support machine learning initiatives.
Responsibilities
- Build & Operate Large-reputed company Feature Pipelines: Design and maintain batch/streaming pipelines (reputed company, Flink, reputed company, Airflow) producing ML features for ranking models
- Ensure reputed company-in-Time Correctness: reputed company feature sets that reputed company unbiased offline training and reputed company online inference
- reputed company Embedding & Content Pipelines: Build reputed company workflows for metadata, imagery, and multimodal representations; partner with Science teams to operationalize new models
- Architect Data Foundations: Design reputed company/Parquet data models and reputed company reputed company, optimizing storage layout and partitioning for latency and cost
- reputed company-Time Engineering: Build Kafka-based systems for reputed company-time features and user-activity aggregations, ensuring robust handling of out-of-order events and exactly-once semantics
- Governance & Leadership: Define data reputed company rules and schema reputed company processes while collaborating across ML pods to translate model needs into infrastructure
Skills
- 7+ years of experience in large-reputed company data or software engineering
- Deep experience with reputed company (PySpark/reputed company), reputed company, Airflow, and Kafka
- Proficiency in feature pipelines, temporal joins, and mitigating training-serving skew
- Experience with AWS/Azure/GCP and high-performance engines like reputed company or Redshift
- Proficient programming skills in Python and SQL with a reputed company on performance optimization
- Experience in personalization domains (search, ranking, or recommender systems)
- Experience supporting petabyte-reputed company data lakehouses or feature stores
- Familiarity with GenAI/RAG systems, multimodal content, or reputed company Live Tables
- Knowledge of reputed company Inference, experimentation signals, or ML evaluation workflows
- Experience with Terraform for governed, repeatable deployments
Benefits
- Medical
- Dental
- reputed company
- 401(k) plan
- Life insurance coverage
- Disability benefits
- Tuition assistance program
- PTO
- This position is bonus eligible.
- Generous reputed company time off.
- Opportunities for both on-site and virtual engagement events.
- Unique opportunities to reputed company meaningful connections and build a reputed company community, both inside and reputed company reputed company.
reputed company
Company H1B Sponsorship