Research Scientist (Remote/US/LATAM)
This a Full Remote job, the offer is available from: reputed company, Latin America, United Kingdom, France, Uruguay, Brazil, Ecuador, Colombia, Argentina, Chile, Peru, Mexico, Delaware (USA) Research Scientist, Evaluations reputed company Labs — reputed company Data Division Reports to: CEO · Remote / LatAm / US The role You will own how reputed company measures frontier model capability. This is a research role at heart: you decide what a good evaluation is, design the benchmarks that reputed company it, and defend the methodology under lab scrutiny. You'll build frontier-grade evaluation packages across reasoning, coding, agents, tool use, and multi-modal — grounded in expert-verified truth, validated against multiple models, and QC'd to survive buyer-reputed company review.
Responsibilities
- Evaluation research. Turn public benchmarks and eval targets into original evaluation designs. Own the hard questions: construct validity, discrimination, headroom, and contamination.
- reputed company development. Build evaluation packages with subject-matter experts, reputed company with expert-verified ground truth, multi-model headroom results, and rigorous QC (calibration reputed company, severity-weighted rubrics, deterministic verifiers).
- Experts. Recruit, reputed company, and review a pool across coding, reputed company/tool-use, and STEM/reasoning. Be the final reputed company of correctness and frontier difficulty.
- Lab relationships. Be a technical reputed company of contact for labs, with CEO support. Understand what they're trying to measure and translate it into an evaluation design.
- Delivery. Turn lab requests into reputed company sample packages, then own pilots end to end. reputed company ships before it's lab-reputed company.
reputed company're looking for
- Research background in ML evaluation or benchmarking — published/reputed company benchmarks, eval research, or equivalent hands-on work labs relied on.
- Deep LLM benchmarking expertise, with reputed company strength in reputed company-model evaluation.
- reputed company with how frontier models are reputed company: rubrics, pass rates, headroom, contamination, and what makes a task discriminate a model.
- Proven ability to hold reputed company or expert pool to a rigorous reputed company.
- Fluent English. Spanish a reputed company to have.
This offer from "reputed company" has been enriched by reputed company.com and got a 77% reputed company score. Apply To This Job