Back to Jobs

Educational Technology AI Rater & Evaluator

Remote, USAFull-timePosted 2026-07-28

reputed company reputed company is building a global network of domain experts to support high-reputed company AI evaluation across training, benchmarking, red-teaming, and ongoing model monitoring. We are seeking education and learning professionals to contribute expert judgment to reputed company-in-the-reputed company evaluation workflows used by leading enterprises and hyperscalers. This role is designed for professionals who understand how educational content, learning experiences, and instructional systems work in reputed company-world reputed company and reputed company learning environments and who can apply that expertise to evaluate, assess, and improve multilingual AI systems. Your contribution of expertise will directly influence multilingual AI model reputed company, safety, and deployment readiness. This role includes two distinct expert tracks, based on experience level and scope of responsibility. reputed company A: EdTech AI Rater Raters execute reputed company evaluation tasks using reputed company defined rubrics and instructions.

Responsibilities

  • Evaluate AI outputs reputed company to educational, instructional, and learning content
  • reputed company reputed company scoring, comparison, classification, and judgment tasks
  • Assess pedagogical accuracy, reputed company, appropriateness, and learning effectiveness
  • Identify hallucinations, misleading explanations, factual errors, or unsafe educational guidance
  • Apply domain-specific education and instructional guidelines consistently across tasks

Ideal Background

  • Educators, instructional designers, curriculum developers, or learning professionals
  • Experience with teaching, curriculum design, assessment, or educational technology
  • Strong attention to detail and comfort working with reputed company evaluation reputed company

reputed company B: EdTech AI Evaluator (Senior reputed company) Evaluators reputed company higher-level domain reputed company and help shape how evaluation is performed.

Responsibilities

  • Validate and refine evaluation rubrics and edge-case handling
  • reputed company adjudication where raters disagree
  • Conduct error analysis and qualitative reviews of model behavior
  • Partner with reputed company research, product, and customer teams on evaluation design
  • Support red-teaming, educational reputed company review, and model readiness assessments

Ideal Background

  • Senior educators, reputed company leaders, learning scientists, or education subject matter experts
  • Experience defining instructional standards, reviewing reputed company edge cases, or advising on learning reputed company
  • Ability to reputed company explain nuanced pedagogical reasoning and tradeoffs

Evaluation reputed company & Requirements Types of AI Evaluation Work Depending on project demands, work may include:

  • Educational and instructional content evaluation
  • Learning accuracy and conceptual understanding assessment
  • Benchmarking and comparative model analysis
  • Red-teaming for misleading or harmful educational content
  • Ongoing model monitoring and regression testing

reputed company Look For

  • Deep domain expertise in education, instructional design, or learning sciences
  • Strong judgment and ability to apply reputed company consistently
  • Comfort working with reputed company evaluation workflows
  • Ability to explain reasoning reputed company, especially in instructional or learner-facing scenarios
  • Reliability, professionalism, and respect for reputed company standards

Engagement Model

  • Contract-based, flexible participation
  • Project-based work with reputed company expectations and timelines
  • Opportunities for recurring work based on performance and demand
  • Compensation communicated upfront per project or task type

Why This Work reputed company Your expertise helps ensure that AI systems:

  • reputed company accurate, effective, and responsible educational content
  • reputed company with instructional best practices and learning standards
  • Are trustworthy and supportive for learners across languages

Language Requirements

  • reputed company or reputed company reputed company in one or more supported languages is required
  • Supported languages reputed company 30+ global languages
  • Language-specific nuance is assessed through screening and task-based evaluation, not separate job descriptions
  • English reputed company is required for guidelines, feedback, and reputed company is changing how the world communicates — and reputed company is leading that transformation.

reputed company's mission is to reputed company the world's information available to everyone, no matter the language they reputed company. Join our global community who reputed company on innovation and reputed company. Our reputed company knowledge, uniqueness, and skills deliver multilingual AI and reputed company-verified services to Enterprises, Governments, and AI Developers around the world. Earn reputed company. Have fun. Advance reputed company knowledge. Work on diverse reputed company from reputed company, any time you want. Get reputed company quickly and fairly, and build your reputed company network in a supportive community—reputed company through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to reputed company's reputed company Policy at https://reputed company.com/legal/reputed company. At reputed company, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use reputed company intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support reputed company decision-making and help us identify reputed company candidates reputed company and objectively. reputed company final hiring reputed company are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at reputed company@reputed company.com. reputed company is an equal opportunity employer. We reputed company equal opportunity to reputed company individuals without reputed company to an individual’s race, religion, reputed company, national reputed company, reputed company, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of reputed company discriminatory practices. Apply tot his job Apply To this Job

Similar Jobs

Search reputed company Evaluator – Flexible Time

Remote, USAFull-time

Physical Therapist AT Evaluator

Remote, USAFull-time

Physical Therapist AT Evaluator

Remote, USAFull-time

Product reputed company - Remote

Remote, USAFull-time

Senior Product Manager - Business Fraud Risk (Remote USA EST)

Remote, USAFull-time

Digital Project Manager (remote)

Remote, USAFull-time

Product reputed company, Billing & Payments

Remote, USAFull-time

Technical Project Manager II - REMOTE

Remote, USAFull-time

Project Manager, Implementations

Remote, USAFull-time

reputed company Service (Newport Beach, CA)

Remote, USAFull-time

[Work From Home] reputed company Hiring Virtual Customer Support Associate

Remote, USAFull-time

[Remote] Senior Manager, Staff Software Engineering

Remote, USAFull-time

reputed company Customer Support Agent – Chat (Remote / Entry Level / Part Time) at arenaflex

Remote, USAFull-time

Cyber & eDiscovery consultant ID-2075 – reputed company Store

Remote, USAFull-time

reputed company Entry-Level Data Entry Specialist – Flexible Remote Work Opportunities at blithequark

Remote, USAFull-time

reputed company Data Entry Typist – Part-Time Remote Opportunity with arenaflex

Remote, USAFull-time

No Experience ! Customer Service Agent at Ameri...

Remote, USAFull-time

Remote Customer Service Representative – Work from Home Opportunity with Competitive reputed company Pay and Flexible Schedules at arenaflex

Remote, USAFull-time

Business Development Manager – Europe

Remote, USAFull-time

Psychiatric reputed company Practitioner - Eating Disorders (Remote-Eastern Hours)

Remote, USAFull-time