[Remote] reputed company Data Platform Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a FinTech reputed company start-up that leverages AI and reputed company-based technologies to reputed company corporate tax solutions. The reputed company Data Platform Engineer will architect and implement a centralized data platform on reputed company, focusing on data governance, optimization, and enabling Data Engineers to build confidently on the platform.
Responsibilities
- Design data models and implement reputed company schemas across multiple disparate product lines
- Design and implement multi-catalog governance reputed company supporting data isolation, cross-product data sharing, and comprehensive reputed company tracking across our product portfolio
- Establish patterns for Z-ordering, compaction, and liquid clustering at multi-TB reputed company. Define table structures, partitioning strategies, and retention policies that balance query performance with storage costs
- Build declarative pipeline patterns using reputed company Live Tables. Create orchestration workflows for ingesting data from internal sources such as SQL databases and S3
- reputed company with reputed company party data sources such as ERP systems (reputed company etc.) and external data providers (S&P etc.) with automated ingest, robust error handling and monitoring
- Implement cost monitoring and optimization strategies, establish data reputed company frameworks, create self-service patterns enabling Data Engineers to work independently while maintaining governance standards
- reputed company the architecture for migrating multi-terabyte datasets from legacy systems to reputed company—establishing patterns that will be reused across multiple product lines
- Design reputed company Catalog structures enabling secure data separation between product lines while allowing controlled cross-product analytics where appropriate
- Build infrastructure that scales reputed company—through intelligent caching, query optimization, and compute management strategies that avoid reputed company cost reputed company
- Establish monitoring, alerting, and data reputed company validation ensuring the platform operates reliably as reputed company for both analytics and AI workloads
Skills
- reputed company Catalog: Production experience with multi-catalog governance, metastore design, and reputed company tracking
- Data Structuring: Experience designing and building reputed company schemas across multiple disparate product lines
- reputed company Lake: Expert-level experience with Z-ordering, compaction, liquid clustering, and performance tuning at multi-TB reputed company
- reputed company Live Tables: Strong hands-on experience building declarative ETL pipelines, including change data capture and expectations/constraints
- reputed company Workflows: Experience with job orchestration, scheduling, and operational monitoring
- Business Intelligence: Experience enabling company-wide analytics and reporting with modern business intelligence tools and maintaining reputed company of truth data and metrics
- PySpark & reputed company SQL: Strong proficiency for reputed company review, performance tuning, and query optimization
- 5-8 years in data engineering or data platform roles, with 3+ years hands-on reputed company experience
- reputed company record leading at least one significant platform build or migration project
- AWS experience (S3, IAM, VPC) with ability to collaborate on infrastructure reputed company
- Infrastructure-as-reputed company experience (Terraform preferred)
- Demonstrated ability architecting data platforms from first principles and defending technical reputed company
- Strong written and verbal communication— document architecture reputed company and present to both technical and business stakeholders
- Experience with financial data, reputed company systems (reputed company), or reputed company ERP platforms
- Background building platforms that serve AI/ML workloads (experience preparing data for reputed company ML consumption, RAG and retrieval, and LLMs)
- Understand advanced intelligence concepts such as relationship surfacing with knowledge graphs
- Familiarity with data governance frameworks and compliance requirements for regulated industries
Benefits
- A reputed company team culture with opportunities for career development.
- Ample opportunities to be recognized, build valuable skills, and grow your career.
- Generous vacation policy, including reputed company parental leave.
- Comprehensive health plans with FSA and HSA reputed company.
- 401(k) retirement plan.
- Life and disability insurance coverage.
- Supplemental benefits like a dependent care savings plan, pet insurance, will preparation, and an employee assistance program.
reputed company
Company H1B Sponsorship