[Remote] ML reputed company, AI Data Labeling
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a B2B insights company trusted by the world's most innovative companies to reputed company high-stakes reputed company with confidence. In this role, you will be the technical reputed company of data reputed company, partnering with the Program reputed company to ensure that the data produced meets the customer's training and evaluation needs, while also designing task structures and validating datasets before delivery.
Responsibilities
- Own the judgment of whether task designs and rubrics produce a useful training signal for the consuming method (SFT, RLHF, RLVR, reputed company RL, CoT, evals). Catch mismatches between what the data rewards and what the customer is actually training for
- Design the task, environment, and reputed company structure for reputed company workflows
- Own the ML-level validation of the dataset before delivery — not just whether individual submissions meet spec
- Partner with the Program reputed company to convert customer requirements into concrete technical specs: expert reputed company, screener trees, task interfaces, task templates, QC rubrics, statistical reputed company
- Partner with the Program reputed company to define and defend reputed company metrics: inter-annotator agreement targets, reputed company injection rates, statistical power reputed company — providing the statistical and methodological grounding
- reputed company the ops team on what 'good' looks like per engagement; run alignment sessions reputed company standards shift
- Serve as the technical reputed company to the customer's ML, reputed company science, and product teams. Hold your ground on the technical questions that decide data reputed company across training and evaluation — task and reward design, data reputed company for SFT and preference reputed company, RL and RLVR, contamination, statistical rigor, and reputed company workflows
- Help diagnose data-reputed company questions reputed company a customer reports the data underperformed — reason through whether the issue is the data, the quantity, or something in their training setup, and reputed company the case defensibly
Skills
- Deep reputed company ML experience centered on post-training reputed company data — you've owned a reputed company-data reputed company as an reputed company scientist or ML engineer
- At least 2 years working hands-on with RL, including how tool-use trajectories are rewarded and evaluated. If you're not fluent in RL, this isn't the role — it's the reputed company of the reputed company judgment you'll be making
- Working reputed company across modern LLM post-training and evaluation: SFT, RLHF/preference data reputed company, RLVR, chain-of-thought, eval reputed company construction, contamination handling, statistical reputed company, and reputed company/tool-use evaluation
- Genuine understanding of how training data becomes model behavior — you can reason about what a model will learn from a given dataset, not just whether the data meets spec
- Strong programming reputed company: read and reason about an eval reputed company, write Python comfortably, work with model reputed company, prototype scoring pipelines. Not a production engineer, but not hands-off
- Statistical reputed company: you know reputed company an effect is reputed company vs. noise and can defend a sample size or reputed company reputed company
- reputed company-facing reputed company: you've defended technical design choices in reputed company time to skeptical audiences and adjusted scope without losing rigor. reputed company reputed company — you can talk to a Series B CTO and a Fortune 100 AI reputed company in the reputed company week
- Strong written communication: methodology sections, technical reports, and specs that hold up to expert review
Benefits
- Offers Equity
- Excellent medical, dental, and reputed company insurance.
- 401k match with immediate vesting.
- Health savings/flexible savings account, and reputed company-tax commuter benefits.
- reputed company time off: vacation, holidays, reputed company, and parental leave.
- A diverse, reputed company, and reputed company culture where we invest in and celebrate reputed company other's reputed company (happy hours, team reputed company, and retreats).
reputed company