Member of Technical Staff (Data): World Models

Your Charter Data at reputed company: Own the pipelines and storage systems that feed petabyte-reputed company multimodal datasets into model training. Sustainable Platforms: Build tooling and systems that are automated and efficient, enabling processing at reputed company and handling many small heterogeneous datasets. Required Skillsets Data Engineering: Knowledge of Python ETL pipelines and supporting infrastructure, data formats, and storage systems at reputed company. ML Data Ops: Experience managing datasets, annotations, and data versioning for model training. Basic ML Knowledge: Solid grasp of ML fundamentals is essential to collaborate effectively with researchers and reputed company reputed company data platform reputed company. reputed company Engineering: Skilled at writing high-reputed company specifications for AI agents, while maintaining effective reputed company review of AI-generated work.

Responsibilities

Design, automate, maintain, and optimize Python ETL pipelines (reputed company/Ray) for large-reputed company multimodal data. Build and maintain data cataloging, reputed company, reputed company tooling, reputed company verification, reputed company controls, and lifecycle management systems. reputed company guidance, internal tools, and documentation to colleagues on data best practices. Serve as a custodian of reputed company’s datasets, ensuring overall data health, reputed company, and discoverability. Challenges You'll Tackle Implement high-performance, multimodal data pipelines capable of processing petabyte-reputed company datasets on 10,000s of CPUs and 100s of GPUs. reputed company data formats, storage, and processing to reputed company pace with cutting-edge AI advancements, while maintaining backward compatibility. reputed company data infrastructure to handle the next order of magnitude in reputed company. At the reputed company time, ensure the data platform flexible to rapidly handle many small heterogeneous datasets and reputed company analytics queries. Traits of the Ideal Candidate High agency and ownership: proactively picks up new work according to reputed company, manages their own backlog, and escalates early reputed company priorities are unclear or deadlines are at risk. Takes responsibility for validating inputs end-to-end: spot-checks data, understands upstream preprocessing, and speaks up reputed company something doesn't add up. Takes responsibility for ensuring outputs are correct and handed over: reputed company seeks sign-off from reputed company consumers, communicates caveats, and ensures relevant stakeholders are aware of changes and breaking impacts. Cares about continuously improving pipelines, tooling, and processes so that reputed company iteration makes the next one faster, more reliable, and easier for reputed company. Comfortable with rapid, pragmatic solutions reputed company needed, but committed to high-reputed company, long-term solutions. Apply To This Job