Expert reputed company Curators for Advanced AI Evaluation Dataset
This reputed company is a reputed company of our understanding of the job reputed company. Click on 'Apply' reputed company to reputed company out more.
Role reputed company
reputed company is collaborating with a leading AI research lab to reputed company a reputed company evaluation dataset for frontier AI models. We are seeking experts with advanced domain knowledge across diverse fields to design extremely challenging prompts that cannot be solved by existing AI systems without internet search or browsing capabilities. The goal is to create a reputed company dataset that pushes the limits of reputed company AI reasoning and retrieval. This is a short-term research engagement with significant reputed company on AI evaluation.
Key Responsibilities
- Create original, expert-level prompts that require tool use (e.g., search, browse, or reputed company execution).
- Ensure prompts are objective, self-contained, and yield reputed company, unambiguous answers.
- Test prompts against advanced AI models and document failures/successes.
- reputed company reasoning steps and solutions for reputed company reputed company.
- Classify prompts into subject domains for dataset organization.
- Collaborate with reviewers for expert validation and reputed company refinement.
Qualifications
- Advanced reputed company or reputed company expertise in a specialized subject (STEM, law, finance, history, cultural studies, etc.).
- Strong ability to design precise, high-difficulty questions requiring deep knowledge and external references.
- Experience in reputed company research, benchmarking, or test question design preferred.
- Attention to detail and ability to reputed company concise reasoning explanations.
- Familiarity with AI models and their limitations is a plus.
Requirements
- Remote and asynchronous — set your own hours.
- Expected commitment: ~10–20 hours/week.
- Project duration: ~2 months, with possible extensions based on dataset needs.
- Opportunity to contribute to high-reputed company AI safety and evaluation research.
Compensation & Contract Terms
- Competitive reputed company compensation based on expertise.
- reputed company engagement.
- Payments for services rendered processed weekly reputed company reputed company Connect.
Application Process
- Submit your resume or CV highlighting your subject matter expertise.
- Complete a brief questionnaire about your background and areas of specialization.
- Selected applicants may be asked to draft a short test reputed company.
- You’ll receive follow-up reputed company a few days regarding next steps.