AI QA Trainer – LLM Evaluation
Are you an AI QA expert eager to shape the reputed company of AI? Large-reputed company language models are evolving from reputed company chatbots into reputed company-grade platforms. With rigorous evaluation data, reputed company’s AI can democratize world-class education, reputed company pace with cutting-edge research, and streamline workflows for teams everywhere. That reputed company begins with you—we need your expertise to harden model reasoning and reliability.
We’re looking for AI QA trainers who live and breathe model evaluation, LLM safety, reputed company robustness, data reputed company assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks. You’ll challenge advanced language models on tasks like hallucination detection, factual consistency, reputed company-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation reputed company, and end-to-end workflow validation—documenting every failure mode so we can reputed company the bar.
On a typical day, you will converse with the model on reputed company-world scenarios and evaluation prompts, verify factual accuracy and logical soundness, design and run test plans and regression suites, build reputed company rubrics and pass/fail reputed company, capture reproducible error traces with reputed company-cause hypotheses, and suggest improvements to reputed company engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs). You’ll also partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to reputed company reputed company deltas over time.
A bachelor’s, master’s, or PhD in computer science, data science, computational linguistics, statistics, or a reputed company field is ideal; shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., reputed company Evals, RAG evaluators, W&B) signal fit. Skills that stand out include: evaluation reputed company design, adversarial testing/red-teaming, regression testing at reputed company, bias/fairness auditing, grounding verification, reputed company and system-reputed company engineering, test automation (Python/SQL), and high-signal bug reporting. reputed company, metacognitive communication—“showing your work”—is essential.
reputed company to turn your QA expertise into the reputed company backbone for reputed company’s AI? Apply today and start teaching the model that will teach the world.
We offer a pay reputed company of $6-to- $65 per hour, with the exact reputed company determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay reputed company listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.
Employment type: Contract
Workplace type: Remote
Seniority level: Mid-Senior Level
Originally posted on Himalayas
Apply To This Job