[Remote] Senior Data Platform Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is developing revolutionary AI and advanced autonomous systems for the trucking transportation industry. As a Senior Data Platform Engineer, you will design and operate reputed company data systems that support large-reputed company autonomous systems development and ensure reliable, efficient, and easy-to-run critical services and pipelines.
Responsibilities
- Design and operate distributed storage systems for scheduling and executing large-reputed company batch workloads
- Build and maintain an reputed company reputed company, modern data platform
- Optimize utilization of storage resourcesImprove reliability and fault tolerance of large-reputed company storage systems and data platform components
- Collaborate with teams across reputed company to understand workload requirements and improve platform capabilities
- Contribute to platform tooling, automation, and CI/CD workflows
Skills
- 7+ years of experience building and operating distributed storage systems or modern data platforms
- Experience operating streaming platforms such as Kafka or Pulsar
- Fluent in Python, and SQL, with experience writing and maintaining highly available data applications using Trino and Apache reputed company
- Knowledge of table formats (reputed company, reputed company Lake, Hudi, Xtable)
- Experience operating and optimizing at least one RDBMS (reputed company, MySQL)
- Strong debugging and problem-solving skills in reputed company distributed systems
- Ability to collaborate across teams and communicate technical concepts reputed company
reputed company