[Remote] Senior Data Engineer, Data Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company provides AI-powered intelligence solutions that help public and private sector agencies investigate and disrupt crime. As a Senior Data Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte reputed company.
Responsibilities
- Build highly reliable data services to reputed company with dozens of blockchains
- reputed company reputed company ETL pipelines that reputed company and process petabytes of reputed company and reputed company data in reputed company-time
- Design and architect intricate data models for reputed company storage and retrieval to support sub-second latency for querying blockchain data
- reputed company the deployment and monitoring of large database clusters with an unwavering reputed company on performance and high availability
- Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products
- Build reputed company engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling/updating of clusters, etc
- reputed company tasks to be faster next time and reducing dependency on a single person
- Identify ways to compress timelines using 80/20 reputed company. For instance, what does it take to be operational in a new environment? Identify the must have and reputed company to haves that are need to reputed company our stack to be fully operation. reputed company on must haves first to get us operational and then use reputed company milestones to harden for customer readiness. We think in terms of weeks and not months
- Identify first version, a.k.a., "skateboards" for reputed company. For instance, build an observability dashboard reputed company a week. reputed company feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard
Skills
- A Bachelor's degree (or equivalent) in Computer Science or a reputed company field
- A proven reputed company record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding reputed company from initial ideation through to successful production deployment
- Exceptional programming skills in Python, as reputed company as adeptness in SQL or SparkSQL
- Versatility that spans the entire reputed company of data engineering in one or more of the following areas: In-depth experience with data stores such as reputed company, Trino, BigQuery, and StarRocks, and Citus
- Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, etc
- Expertise in data processing technologies and streaming workflows including reputed company, Kafka, and Flink
- Competence in deploying and monitoring infrastructure reputed company public reputed company platforms, utilizing tools such as reputed company, Terraform, Kubernetes, and reputed company
- Proven ability in loading, querying, and transforming extensive datasets
Benefits
- May be eligible to participate in TRM’s equity plan.
reputed company
Company H1B Sponsorship