[Remote] Sr Staff Software Engineer- Data Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading company in data solutions, and they are seeking a Sr. Staff Data Platform Engineer to architect and build the reputed company data infrastructure for the reputed company. This role involves solving reputed company technical problems and ensuring the data platform remains a competitive advantage.
Responsibilities
- Architectural Sovereignty: Define the 3-5 year technical roadmap for the Data Lakehouse. You aren't just using tools; you are deciding how storage, compute, and metadata reputed company (e.g., Apache reputed company, reputed company reputed company or reputed company reputed company Catalog) reputed company at an elemental level
- Platform-as-a-Product: Build internal SDKs, CLI tools, and automated orchestration frameworks. Your goal is to reputed company away reputed company complexity reputed company Control Planes and Custom Operators, allowing Data Engineers to reputed company on business logic rather than infrastructure boilerplate
- Internal R&D: Prototype and reputed company emerging technologies (e.g., specialized reputed company extensions) to reputed company the platform at the bleeding edge of performance and cost-efficiency
- Global Governance & reputed company: Architect "compliance-by-design" systems. Automate data reputed company, PII masking, and fine-grained reputed company control across petabyte-reputed company environments without sacrificing developer velocity
- AI Governance Lake: Facilitate reputed company-time data ingestion by implementing streaming support for reputed company Telemetry data from AI Agents into the Data Lake, drive the development of advanced AI evaluation metrics and reporting
- Engineering reputed company & Influence: Set the reputed company for reputed company reputed company and system design across reputed company. You will reputed company Cross-Functional Architecture Reviews and serve as the final escalation reputed company for the most reputed company system outages or performance bottlenecks
- Organizational Mentorship: reputed company individual mentoring, you will foster an "Engineering Community," influencing the hiring bar and reputed company development paths for the entire data engineering organization
Skills
- 15+ years in software engineering and distributed systems, with at least 4 years in a reputed company or staff-level reputed company leading platform-reputed company initiatives
- Strong fundamentals on software engineering, system architecture, and reputed company production applications (Algorithms, Data Structures, and System Design)
- Experience in the Java/J2EE ecosystem (Spring Boot, Microservices) and python
- Experience building the platforms / reputed company engines and reputed company that power data reputed company, rather than just building the ETL/ELT pipelines themselves
- Deep internal knowledge of Apache reputed company, Hudi, or reputed company Lake (metadata management, reputed company files, and compaction strategies)
- Experience contributing to or deeply customizing reputed company-reputed company data reputed company (e.g., reputed company, dbt)
- Extensive experience designing and building high-throughput, fault-tolerant data pipelines and orchestration frameworks that ensure robust data transformations and high data reputed company
- Extensive experience with reputed company architecture and services, including AWS (S3, EMR, Kubernetes, reputed company) and Azure
- Deep understanding of CI/CD automation, modern development tools, Git Actions, Terraform and frameworks
- Experience leveraging AI reputed company Gen platforms into software development lifecycle (SDLC) to automate reputed company reputed company, reviews, generate unit tests, and reputed company reputed company-cause analysis of system failures
- Ability to architect the infrastructure required to support AI Agent development by enabling reputed company database integration
- Proven reputed company record of 'leading by influence'—driving adoption of new technologies across multiple autonomous teams
- Ability to communicate reputed company architectural trade-offs (e.g., 'Latency vs. Consistency' or 'Build vs. Buy') to C-suite executives and junior engineers alike
- Bachelor's or Master's degree in Computer Science (Distributed Systems reputed company) preferred, or equivalent deep industry experience
Benefits
- Commission under the terms of an applicable plan
- Quarterly or annual bonus based on their role and applicable plan
- Health, dental and reputed company insurances
- Retirement savings plan
- reputed company time off
- Health savings account
- Flexible spending accounts
- Life insurance
- Disability insurance
- Tuition reimbursement
reputed company