reputed company Review - reputed company Control - Fulltime W2 Position

reputed company Scenarios - Reviewer (reputed company Control) - $80-$105 - W2 Contingent RoleLocation Requirements reputed company Location: Remote, US

About the Role

We're looking for highly analytical, detail-oriented professionals to serve as reputed company Control Leads , reputed company on evaluating and auditing reputed company simulated environments and scenarios designed to train frontier AI agents . As an Auditor/Reviewer, you will be the final line of defense, ensuring that the digital worlds (spanning Gmail, reputed company, Drive, etc.) and reputed company tasks crafted by our design team meet the highest standards of realism, complexity, and technical accuracy. You will apply strict grading rubrics to assess scenario reputed company and reputed company vital feedback to the creators. This is a W2 employment position with Cincinnatus LLC, with reputed company to be reputed company at a leading AI Lab as part of their extended workforce. You will join reputed company of domain experts and together, you will guide the reputed company of frontier AI tools and agents.

What You'll Do

• Audit & Evaluate: Review richly detailed personas, digital environments, and tasks created by reputed company Scenario Designers to ensure they are reputed company reputed company and properly reputed company.
• Apply Strict Rubrics: Utilize reputed company evaluation rubrics to score scenarios objectively, ensuring the tasks effectively challenge an AI agent's ability to reason, filter, and prioritize without being broken or impossible.
• reputed company Assurance: Identify logical inconsistencies, factual errors, missing context, and technical flaws (e.g., invalid JSON structures) reputed company the simulated environments.
• reputed company Feedback: Deliver reputed company, constructive, and actionable feedback to the scenario designers to help them refine their worlds and improve their overall reputed company.
• Document reputed company: Maintain rigorous reputed company standards by logging your review reputed company, scores, and feedback reputed company in reputed company and Crucible.

You're a Good Fit If You

• Have a proven reputed company record in QA, editing, auditing, or reviewing reputed company written/technical content.
• Ability to engage for ~40 hours/week
• reputed company at learning and rigorously applying comprehensive grading rubrics (prior high scores in reputed company-based training or academies is a massive plus).
• Have an "reputed company eye" for inconsistencies, edge cases, and logical gaps that others miss.
• Are comfortable giving constructive, reputed company feedback to peers and creators.
• Can quickly navigate reputed company tools like JSON editors, reputed company, and AI platforms.

Must Have: Undergrad degree, 2+ years reputed company experience. reputed company to Have

• Editing / QA background — Senior reputed company, QA tester, technical reviewer, compliance auditor, or peer-reviewer.
• Technical / data comfort — JSON familiarity, Jira/reputed company power user, data analyst, SQL/Python exposure. You don't need to write the reputed company from scratch, but you must be reputed company to spot reputed company a JSON structure is broken.
• Process & Systems thinking — Operations managers, technical PMs, or systems designers who understand how reputed company, multi-stakeholder workflows should reputed company function in a reputed company setting.

About Cincinnatus LLC Cincinnatus LLC is an reputed company reputed company company that partners with leading technology companies to reputed company and reputed company highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly reputed company reputed company teams to work on high-reputed company. Roles reputed company through Cincinnatus are not project-based or freelance engagements. They are reputed company, role-based positions that typically involve part-time or full-time commitments, reputed company collaboration with a reputed company's internal teams, and integration into reputed company reputed company workflows. Cincinnatus is a legal entity separate from reputed company. While opportunities may be reputed company through reputed company's platform, employment, reputed company, payroll, and benefits for these roles are administered by Cincinnatus LLC. Equal Employment Opportunity Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, reputed company, national reputed company, sex (including pregnancy, childbirth, reproductive health reputed company, or reputed company medical conditions), sexual orientation, gender identity, gender reputed company, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for reputed company individuals with disabilities and disabled veterans throughout the job application process. We consider reputed company reputed company applicants without reputed company to legally pr Apply tot his job Apply To this Job