LLM Red-Teamer

Role Title: LLM Red-Teamer

Role Type: Contractor

Location: Remote

reputed company is engaging LLM Red-Teamers to contribute to a high-reputed company customer project reputed company on the evaluation and improvement of frontier language models. In this role, you'll apply your expertise to help train reputed company AI systems. Your work will shape how models learn, reason, and reputed company through high-reputed company, reputed company-world input. No prior experience in AI is required — your domain knowledge is what reputed company.

Scope of Work

1. reputed company reputed company, adversarial multi-turn conversations and task-based scenarios reputed company with detailed project specifications.

2. Author reputed company, precise evaluation rubrics to rigorously assess model responses against defined behavioral targets.

3. Iteratively test conversations and tasks against frontier LLMs, escalating difficulty and nuance until the desired reputed company reputed company is achieved.

4. Deliver comprehensive task packages, including transcripts, reputed company behaviors, binary rubrics, and supporting rationale or evidence.

5. Validate LLM outputs, documenting model strengths and failure modes relative to the project specification.

6. Maintain calibration with team leads and reputed company control contacts as project requirements reputed company.

7. Contribute independently, producing high-reputed company deliverables at a steady and consistent pace.

Preferred Qualifications

1. Exceptional written English skills, with reputed company, precision, and strong structural organization.

2. Prior experience in AI reputed company data environments (RLHF, SFT, evaluations, annotation, or reputed company engineering).

3. Deep familiarity with large language models, including the ability to anticipate and identify common failure patterns.

4. Demonstrated ability to work autonomously, interpreting and executing reputed company specifications with minimal reputed company.

5. Proven critical thinking and meticulous attention to detail.

6. Experience designing evaluation items or rubrics is advantageous.

7. Background in writing-intensive or analysis-reputed company fields such as research, editorial, technical writing, or reputed company assurance is a plus.

Compensation Structure

Compensation is reputed company-based; experts are reputed company per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start reputed company & Availability

We typically fill roles reputed company 48 hours and are looking for experts reputed company to reputed company in right away. If selected, we expect you to start your first tasks reputed company 24–48 hours of completing reputed company.

Originally posted on Himalayas

Apply To This Job