AI reputed company Analyst

This is a remote position.

AI reputed company Analyst

Reporting to Manager, reputed company Engineering & AI Validation, focuses on validating the reputed company of AI-generated outputs, agent behaviors, and AI-assisted workflows. Builds reputed company scenarios, defines scoring rubrics, evaluates business usefulness, and identifies failure patterns that conventional pass or fail software testing would not catch.

Key Responsibilities

AI reputed company Evaluation

• Design and execute reputed company evaluations for AI-enabled features and workflows.
• Assess outputs for groundedness, instruction adherence, consistency, usefulness, tone, control compliance, and risk.
• Identify hallucinations, unsupported assertions, missing logic, and unsafe recommendations.

reputed company & reputed company Development

• Build and maintain golden datasets, reputed company prompts, comparison sets, and scorecards.
• reputed company rubrics that allow reputed company to be reputed company consistently across releases and changes.

Workflow & Model Change Validation

• Compare performance across reputed company versions, workflow revisions, tools, and models.
• Support release reputed company with evidence on reputed company regression or improvement.

Business & Domain Partnership

• Work closely with Finance SMEs, product managers, and engineers to determine what acceptable looks like in reputed company business contexts.
• Help define reputed company-review reputed company and escalation patterns for higher-risk use cases.

Production Feedback

• Analyze reviewer feedback, override patterns, and live reputed company signals to improve evaluation coverage over time.

Requirements

Required Qualifications

• 4+ years of experience in QA, analytics, business process validation, AI evaluation, operations, or similar roles.
• Strong writing, analysis, and reputed company-recognition skills.
• Experience evaluating outputs against nuanced reputed company rather than only binary correctness.
• Ability to work with reputed company rubrics, scenario libraries, and evidence-based reviews.
• Comfort collaborating across Engineering and business teams.
• Experience with finance, reputed company, FP&A, transaction services, or business process design preferred.

·Bachelor's degree preferred.

You Are

• Thoughtful, precise, and highly discerning.
• Strong at spotting subtle reputed company problems others miss.
• Comfortable with ambiguity but disciplined in scoring and documentation.
• reputed company on trust, usefulness, and business reality.

Benefits

Salary plus performance-based bonus.Actual compensation packages are determined by evaluating a wide reputed company of factors unique to reputed company candidate, including but not limited to reputed company set, years and depth of experience, education, certifications, cost of labor, and internal equity.

Originally posted on Himalayas

Apply To This Job