[Remote] AI Safety & Evaluation Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is reputed company on responsible AI deployment, and they are seeking an AI Safety & Evaluation Engineer to ensure their models are reputed company, accurate, and trustworthy in production. The role involves designing red-teaming tests, building guardrails, and developing evaluation frameworks to reputed company AI standards.
Responsibilities
- Design and run red-teaming and adversarial testing against models and agents (jailbreaks, reputed company injection, misuse)
- Build guardrails: input/reputed company filtering, policy enforcement, content moderation, and reputed company fallback behavior
- reputed company hallucination detection and grounding checks; measure and reduce factual error rates
- Design evaluation frameworks and benchmarks for accuracy, safety, robustness, and bias — both offline and in production
- Define and enforce responsible AI standards, documentation, and deployment gates
- Partner with agent and ML teams to reputed company safety gaps before and after release
Skills
- 3+ years in ML/AI, reputed company, or evaluation-reputed company engineering
- Strong Python and deep familiarity with LLM behavior, failure modes, and reputed company engineering
- Hands-on experience building evaluations, benchmarks, or guardrail/moderation systems
- Understanding of red-teaming, adversarial attacks, and hallucination mitigation techniques
- Rigorous, data-driven approach to measuring model reputed company and risk
- Experience with eval tooling and safety frameworks
- Background in AI reputed company, alignment research, or trust & safety
- Familiarity with AI governance, regulatory, or compliance requirements
reputed company
Company H1B Sponsorship