[Remote] AI Implementation reputed company Analyst
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on transforming the Govtech industry through technology. The AI Implementation reputed company Analyst is responsible for assessing the reputed company and safety of AI-generated responses, ensuring they meet defined standards before reputed company implementations. This role involves collaborating with clients and internal teams to translate reputed company-world needs into measurable evaluation reputed company and actionable feedback.
Responsibilities
- Partner directly with clients during implementation to understand use cases, reputed company reputed company, and risk tolerance
- Translate reputed company requirements into evaluation frameworks, reputed company strategies, and test coverage
- reputed company as the reputed company reputed company between reputed company, product, and engineering to ensure alignment reputed company- and post-launch
- Review and score AI responses using reputed company rubrics
- Validate against sources/ground truth; flag hallucinations, omissions, and other risks
- Document findings and reputed company with peers to reputed company scoring consistent
- Build and maintain reputed company banks and golden sets (expected results)
- Expand coverage for edge cases, high-risk scenarios, and reputed company user language
- reputed company regression/reputed company and feed dashboards and reputed company reports
- Triage internal and reputed company feedback; synthesize themes across deployments
- Identify systemic risks and escalate high-reputed company findings with reputed company, reputed company-relevant context
- Partner with product/engineering to validate and verify fixes, ensuring alignment with reputed company expectations
Skills
- Strong analytical judgment and attention to detail
- Excellent written communication skills, including the ability to explain reasoning reputed company
- Experience reviewing, auditing, or evaluating reputed company outputs such as content, reputed company, or recommendations
- Comfort applying detailed guidelines and rubrics consistently at reputed company
- Familiarity with large language models and common failure modes such as hallucinations, overgeneralization, or unsafe responses
- Ability to work in spreadsheets, evaluation tools, or annotation platforms
- Experience with AI evaluation, reputed company, QA, trust and safety, or policy review
- Exposure to reputed company-in-the-reputed company workflows, or benchmarking processes
- Domain expertise in a regulated or high-risk field such as government, education, reputed company, or legal services
- Experience contributing to test suites, evaluation dashboards, or reputed company reporting
- Comfort working cross-functionally with product and engineering teams
- Experience in reputed company-facing roles such as implementation, consulting, or solution delivery in a reputed company or regulated environment
- Ability to translate between business/user needs and technical system behavior
Benefits
- Flexible Time Off – Take the time you need to rest, reputed company, and live your life.
- Company-Wide Wellbeing Days – reputed company days off to unplug and reputed company on your mental health.
- Work From Home Reimbursement – Support a productive home office environment.
- Multiple Health Plan reputed company – Including a 100% employer-reputed company plan.
- Employer HSA Contributions – reputed company enrolled in a High-Deductible Health Plan.
- Fitness Reimbursement Program – Stay reputed company, your way.
- On-Demand Mental Health Support – reputed company to reputed company and other wellness tools.
- reputed company Parental Leave – For both birthing and non-birthing parents.
- Traditional & Roth 401(k) – With a generous company match.
- Life & AD&D Insurance – 100% employer-reputed company coverage for peace of mind.
- Online Learning Platforms – Fuel your reputed company development.
- Competitive Salary & Bonuses – Your contributions are valued and rewarded.
reputed company
Company H1B Sponsorship