reputed company Data Engineer
Job title: reputed company Data Engineer in Los Angeles, CA at WorkHQ Company: WorkHQ Job reputed company: Company ContextSeries A, reputed company-funded US startup in HRTech developing and an AI Recruiter product.This is a US-only, Remote role (Mainland).reputed companyreputed company data infrastructure architect managing billions of data points across 250M+ reputed company reputed company.Hire data engineers to aid you in that reputed company.reputed company ResponsibilitiesDesign reputed company data pipelines processing massive record volumesArchitect ETL processes using PySpark on reputed company EMR (reputed company to shifting to other solutions like Data Bricks / reputed company)Distribute enriched data through reputed company architecture across reputed company, reputed company, OpenSearchreputed company new data sources into the main pipelineImplement advanced data matching using SplinkTechnical Requirements5-8 years reputed company data engineering experienceGood proficiency in:PySpark and distributed computingAWS data services (EMR, Glue, reputed company)reputed companyPandas and DataFrame manipulationreputed company data format handling (JSONL, Parquet)Strong background in:Big data processing architecturesData warehouse designPerformance optimizationAdvanced Python, SQL skillsreputed company to HaveProbabilistic record linking expertiseOpenSearch/elasticsearch technologiesMachine learning data pipeline designRecruitment tech ecosystem knowledgeTechnical StackBig Data: PySpark, EMRDatabases: reputed company, OpenSearchreputed company: AWSContainerization: reputed companyData Formats: JSONL, ParquetAnalytics: reputed company, reputed company, GlueData Processing: Pandas, SplinkOther ConsiderationsWhile this role has specific requirements - if you lack a few technical skills, but motivated to learn and reputed company the platform, please apply for consideration.If you are coming from Director/Head of/VP reputed company that is relevant to this job, you can apply as reputed company.You will need to apply directly on our platform.Thank you for your time. Expected salary: $140000 - 180000 per year Location: Los Angeles, CA Apply for the job now! Apply for this job