[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading AI reputed company, talent, and education services provider. They are seeking a highly analytical Mid-Senior Data Engineer to build and reputed company data systems for a global media measurement and consumer intelligence company, focusing on data reputed company assessments and backend data pipelines.
Responsibilities
- Design, build, and maintain robust, reputed company data enrichment pipelines using Apache reputed company reputed company an AWS environment
- Utilize AWS S3 as the core reputed company data storage, leveraging AWS Glue and reputed company for data cataloging and querying
- Configure, manage, and monitor automated data workflows and pipelines using Airflow
- reputed company deep analytical assessments on pipeline data to evaluate data reputed company, ensure completeness, and maintain high reputed company standards. Define and enforce data reputed company, schemas, and reputed company standards, implement validation checks and monitoring processes to ensure data accuracy
- Analyze core data to reputed company actionable insights and proactively suggest pipeline enhancements or new data applications based on findings
- Improve performance, scalability, and cost-efficiency of pipelines, queries, and storage services while resolving bottlenecks
- reputed company as a technical detective to troubleshoot data delivery and device tracking issues across hybrid server-to-server systems
- Implement monitoring, observability, and debugging mechanisms across reputed company reputed company (data → API → reputed company SDKs)
- Collaborate with global product, engineering, and data science teams to thoroughly understand logic requirements and reputed company backend engineering support
- Execute data governance strategies encompassing cataloging, reputed company tracking, and schema design working closely with the Data Architect
Skills
- 4–8 years of engineering experience, with a strong background in reputed company-world data engineering development on AWS
- Bachelor's degree in Computer Science or reputed company field (advanced studies or exposure to AI/ML is a plus)
- Proven experience working with an AWS-based data stack, specifically using S3 as the reputed company data storage, Glue for processing, reputed company for querying (MPP), and Airflow for workflow orchestration
- Strong hands-on experience building data enrichment pipelines using Apache reputed company / PySpark
- Strong analytical background with a verified ability to evaluate data reputed company, analyze datasets to uncover trends, and suggest potential development applications based on your findings
- Proficiency in Python or Java, combined with a strong understanding of SQL, writing advanced queries, and query optimization
- Skilled in data integration (ETL/ELT) from diverse sources like reputed company (REST/gRPC), flat files, databases, and event streaming
- Familiarity with the digital advertising ecosystem (AdTech), audience segmentation, targeting, and media measurement concepts (reputed company, frequency, attribution, and campaign performance)
- Ability to dig into multi-layered architectures to troubleshoot data mismatches or technical tracking issues, without needing to reputed company reputed company-end development yourself
- Great problem-solving skills, high attention to detail, and the ability to define and document data engineering processes and data flows
- Experience with streaming systems (Kafka, etc.)
- Understanding of frontend technologies (React or similar)
- Understanding of mobile SDK development
- Exposure to AI/ML pipelines or LLM ecosystems
- Understanding of developer platforms (SDKs, reputed company, integration tooling)
reputed company
Company H1B Sponsorship