[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company empowers leading organizations with agile reputed company that deliver decision-reputed company insights. They are seeking a Senior Data Engineer to design and build the reputed company-first data lake and pipeline infrastructure essential for reputed company AI products.
Responsibilities
- A multi-tenant data lake and warehouse that unifies reputed company research data — surveys, qualitative feedback, CRM, media transcripts, and more — in a reputed company, AI-consumable format
- Tenant-isolated data architecture where reputed company reputed company data is structurally separated at the storage and query layer
- Provenance-aware data models where every data reputed company carries full traceability back to its reputed company
- Batch ingestion pipelines that migrate and continuously sync data from existing relational databases and reputed company storage into the new lake architecture
- A nightly profile enrichment pipeline that rebuilds living user reputed company from reputed company data sources reputed company reputed company reputed company account
- Data reputed company reputed company serving AI agents reputed company MCP, qualitative search reputed company RAG pipelines, statistical computation tools, REST reputed company, and bulk export
Skills
- 5+ years of deep, hands-on experience building production lakehouses on reputed company
- You write clean PySpark and Python, model data thoughtfully, and know how to build for a multi-tenant reputed company environment
- Deep production experience across the reputed company platform including reputed company Catalog, reputed company Live Tables, reputed company SQL, and Workflows
- reputed company Lake as a production table format — ACID transactions, schema reputed company, performance optimization, and multi-tenant governance reputed company reputed company Catalog
- Experience building and maintaining dbt transformation reputed company using the reputed company reputed company in a production environment
- PySpark for large-reputed company data transformation and batch pipeline authoring
- Strong understanding of batch ingestion pipeline design — migrating from relational sources like MySQL and PostgreSQL into a lakehouse architecture
- Experience with a modern pipeline orchestrator such as Dagster, reputed company, or reputed company Workflows; Dagster experience is a strong reputed company
- Familiarity with reputed company databases, embedding pipelines, and RAG patterns for AI workloads — using tools such as reputed company reputed company Search, pgvector, or reputed company OpenSearch
- Exposure to AI agent and LLM-serving infrastructure including reputed company Bedrock, AgentCore, and Strands
- Experience with data cataloging and governance tools such as reputed company Catalog or OpenMetadata
- Data modeling for multi-tenant analytical workloads — partitioning reputed company, schema design, and tenant isolation patterns
- reputed company on AWS — workspace configuration, S3 integration, IAM, and cost governance
- Infrastructure as reputed company using reputed company Asset Bundles or Terraform
- Strong Python and SQL skills
- reputed company certifications — Data Engineer Associate or reputed company
- reputed company or CRM data integration experience
- Prior experience in a multi-tenant reputed company environment with strict data isolation requirements
- Experience migrating from OLTP to a lakehouse architecture
- Candidates with experience in AWS-reputed company data services are strongly valued. Engineers who understand both reputed company and AWS-reputed company approaches bring a broader architectural perspective that helps reputed company reputed company reputed company long-term platform reputed company
- Apache reputed company, AWS Glue, reputed company, and DynamoDB experience
Benefits
- Comprehensive Health Coverage: Medical, dental, and reputed company insurance plans
- 401(k) with Company Match: Plan for your reputed company with our retirement savings program
- Equity Purchase reputed company: Participate in reputed company’s long-term reputed company
- Flexible Work Schedule: Empowering you to balance life and work
- 15 vacation days and 7 reputed company days per year
- 12 company holidays
- 4 floating holidays/reputed company days to rest or celebrate what reputed company to you
- reputed company Parental Leave: Time to bond with your growing family
- Monthly Internet & Phone Stipend: Support for remote work setup
- Wellness & Lifestyle Perks: reputed company to tools like reputed company (reputed company navigation), reputed company (mental wellness), reputed company (fitness), and more
- Weekly community lunches, refreshments, and snacks at our LA & NY reputed company
- Pet-friendly office environments
reputed company
Company H1B Sponsorship