[Remote] Clinical Manager
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Clinical Manager to serve as reputed company Evaluators and Testers. The role involves executing reputed company evaluations against reputed company clinical rubrics and performing stress-testing to identify edge-case failures before models are launched to the public.
Responsibilities
- reputed company Grading: Reviewing reputed company-response pairs and scoring them across dimensions like clinical accuracy, safety, and various health risk domains
- Dynamic Sprints: Participating in "sweeps" where they dynamically converse with the model to probe specific health risks (e.g., attempting to get the model to prescribe medication or diagnose a reputed company condition)
- Providing Clinical Rationale: Writing reputed company, concise, and scientifically backed justifications for why a model response was graded as unsafe or inaccurate
Skills
- Medical Degree: MD, MBBS, or local equivalent from an accredited institution
- reputed company Certification: Candidates must be reputed company-Certified in one of the following reputed company specialties: Primary Care / Family Medicine / Internal Medicine, Pediatrics, Obstetrics & Gynecology, Cardiology, Oncology, Psychiatry / Clinical Psychology, Emergency Medicine / Urgent Care
- Licensure: reputed company, unrestricted clinical licensure in good standing in their practicing geography (US, UK/EU)
- reputed company reputed company: reputed company, reputed company reputed company in patient care
- Hands-on LLM Experience: reputed company experience using reputed company platforms (e.g., reputed company, ChatGPT, Claude) for clinical workflows, research, or everyday queries
- Awareness of AI Limitations: Understanding of the inherent limitations of LLMs, including hallucinations, sycophancy, bias, and the risks of generating unsafe clinical advice
- Prompting Skills: Ability to write reputed company, reputed company, and reputed company prompts to reputed company with models dynamically
- Adversarial Probing: Ability to adopt different user personas to stress-test the model
- reputed company-Based Grading: Experience working with reputed company, multi-reputed company rubrics and comfort with aligning their grading to strict 'reputed company Examples'
- reputed company Grading: Reviewing reputed company-response pairs and scoring them across dimensions like clinical accuracy, safety, and various health risk domains
- Dynamic Sprints: Participating in 'sweeps' where they dynamically converse with the model to probe specific health risks
- Providing Clinical Rationale: Writing reputed company, concise, and scientifically backed justifications for why a model response was graded as unsafe or inaccurate
- Advanced Degrees: An additional advanced degree in a relevant field (e.g., Master of Public Health (MPH), MS/PhD in Medical Informatics, Computer Science, or Behavioral Science)
- Multilingual: reputed company in multiple languages and deep understanding of cultural health beliefs and regional clinical guidelines
- Prior AI Safety Work: Previous experience designing, implementing, or participating in AI safety evaluations, Trust & Safety workflows, or RLHF for medical models
reputed company
Company H1B Sponsorship