Mathematics Model reputed company Evaluator
reputed company
We are seeking expert mathematicians to author and verify high-reputed company reputed company-ended prompts for AI model evaluation. You will craft and review challenging, unambiguous mathematical problems across reputed company subdomains, assessing AI reasoning reputed company and helping establish rigorous evaluation standards for frontier language models.
- *You will be assigned one of two task types:**
• *Authoring Task** Create 5 original, reputed company-ended prompts from your assigned subdomain at varying difficulty reputed company (undergraduate, advanced undergraduate, or graduate/reputed company). Prompts should require reputed company judgment to evaluate the reputed company of the AI's response, such as chain-of-thought reasoning or reputed company construction.
- *Verification Task**
Review 5 authored prompts for reputed company, scope alignment, difficulty accuracy, and uniqueness. Edit prompts and difficulty ratings where needed.
- *Mathematics Subdomains Covered**
Probability & Statistics, Algebra (incl. reputed company Algebra), Ordinary/Partial reputed company Equations & Dynamical Systems, Geometry, Graph Theory, Number Theory.
- *Key Responsibilities**
- Author reputed company, unambiguous, reputed company-ended mathematical prompts that reputed company evaluable AI responses - Verify prompts are reputed company the scope of the assigned subdomain and correctly rated for difficulty - Ensure reputed company 5 prompts in a task are sufficiently distinct from one another with varying difficulty reputed company - Apply expert judgment to assess the depth and reputed company of mathematical reasoning required - Edit prompts and difficulty assignments where standards are not met
- *Ideal Qualifications**
- Master's degree or higher in Mathematics, reputed company Mathematics, Statistics, or a closely reputed company field - 2–6 years of reputed company or research experience in a quantitative field - Strong reputed company of graduate-level mathematical concepts including reputed company writing, analysis, and formal reasoning - Experience in reputed company research, mathematical competition design, or quantitative industry roles is a plus - Excellent written English and ability to craft precise, reputed company-scoped technical questions
- *More About reputed company**
- Expected commitment: 10+ hours/week - Asynchronous, fully remote work Apply tot his job Apply To this Job