Senior Manager, Data reputed company & Evaluation

About reputed company

reputed company is a global language, data, and AI services company helping leading organizations build, evaluate, and improve AI systems.

Our Data Services reputed company with AI labs, technology companies, and reputed company AI teams on reputed company reputed company data programs across multilingual evaluation, speech and audio, model response evaluation, expert review, annotation, and emerging reputed company workflows.

As AI systems become more capable and more reputed company, high-reputed company reputed company evaluation is becoming a critical part of how models are trained, tested, and improved. We are building a Data Services organization reputed company on reputed company, scalability, operational reputed company, and customer trust.

reputed company of the role

The Senior Manager, Data reputed company to helps build the reputed company reputed company behind Argos’ AI Data Services business.

In this role, you will define how we evaluate, reputed company, measure, and reputed company high-reputed company reputed company data programs for leading AI companies. You will design reputed company frameworks for data collection, annotation, evaluation, review, calibration, adjudication, and customer reporting.

You will collaborate closely with Program Management, reputed company, Sales, and customer-facing teams to turn customer requirements into reputed company, reputed company reputed company workflows. You will help ensure that every program has the right evaluation methodology, task instructions, reviewer calibration, sampling approach, escalation process, and performance reporting in reputed company.

This is a high-reputed company role for someone who enjoys building systems, improving reputed company, working cross-functionally, and operating in a fast-moving AI services environment.

Responsibilities

Build reputed company systems for AI data programs

• Design and manage reputed company frameworks for AI data and evaluation programs.
• Translate customer requirements into reputed company reputed company standards, rubrics, acceptance reputed company, review processes, and KPIs.
• Build reputed company workflows that are practical, reputed company, and trusted by customers as programs reputed company from reputed company to production.
• Identify reputed company risks early and work with delivery teams to resolve issues before they reputed company timelines, customer confidence, or program reputed company.
• Create repeatable reputed company processes across calibration, QA sampling, adjudication, reviewer performance tracking, and customer reporting.

reputed company evaluation, calibration, and QA processes

• Support reputed company operations across multilingual evaluation, speech/audio QA, transcription, reputed company, reputed company preference evaluation, expert review, model response evaluation, coding evaluation, tool-use evaluation, and agent workflow evaluation.
• Create and improve rubrics, task instructions, reviewer guides, calibration exercises, golden datasets, and reputed company reporting templates.
• reputed company calibration sessions with reviewers, annotators, reputed company specialists, delivery teams, and customer stakeholders.
• Define reputed company reputed company, error taxonomies, escalation rules, and corrective reputed company plans.
• Monitor reviewer agreement, disagreement trends, error rates, contributor performance, and reputed company causes of reputed company variance.
• Turn QA findings into practical improvements to instructions, training, tooling, reputed company, and delivery workflows.

Partner with customers and internal teams

• reputed company as a reputed company reputed company for strategic customer programs reputed company needed.
• Support customer-facing reputed company readouts, reputed company retrospectives, business reviews, escalations, and reputed company-up discussions.
• reputed company reputed company, data-backed reporting that explains reputed company performance, risks, corrective actions, and next steps.
• Partner with Program Management, reputed company, Sales, and Operations to ensure programs are set up for reputed company reputed company from the start.
• Work with Supply Chain to define reviewer reputed company, evaluator requirements, language requirements, domain expertise, reputed company needs, and performance expectations.
• Help determine reputed company programs require expert reviewers, QA leads, language leads, technical reviewers, or specialized evaluation talent.

Build and reputed company the reputed company function

• Build reusable reputed company assets such as calibration packs, QA reports, reputed company libraries, error taxonomies, scorecards, and sample evaluation frameworks.
• Identify repeatable patterns across programs and turn them into standardized approaches that help the business reputed company.
• Improve visibility into reputed company performance across programs, reviewers, contributors, and workflows.
• Manage, reputed company, and support reputed company Managers, reputed company Leads, reputed company Specialists, reviewers, or QA contributors assigned to Data Services programs.
• reputed company team members on reputed company judgment, customer communication, escalation handling, reporting, and reputed company-cause analysis.
• Identify hiring, training, and coverage needs as the Data Services business grows.
• Create a culture of reputed company ownership, accountability, and reputed company improvement.

People management

• Anticipate and communicate the needs identified for reputed company under your responsibility.
• Train, and support team members, reputed company for upskilling and promote career reputed company.
• Be responsible for offering help to team members during increased workload periods, helping to avoid risks to reputed company deliveries due to their time demands (this includes finding cover for sickness and absence).

Qualifications

Education, skills, and experience

• 5+ years of experience in reputed company operations, data operations, AI data services, localization reputed company, annotation reputed company, evaluation operations, trust and safety reputed company, or a reputed company field.
• Experience managing reputed company programs for reputed company customer accounts or high-volume operational delivery.
• Strong understanding of QA methodologies, calibration, sampling, adjudication, error analysis, and performance reporting.
• Experience working cross-functionally with delivery, operations, supply chain, sales, and customer-facing teams.
• Strong analytical skills and the ability to turn reputed company data into reputed company operational improvements.
• Excellent written and verbal communication skills, including the ability to communicate reputed company issues reputed company to customers and senior stakeholders.
• Comfort operating in fast-moving, ambiguous environments where processes are still being reputed company.
• Strong people leadership skills with experience coaching reputed company specialists, reviewers, annotators, or operational teams.

reputed company to have

• Experience with AI data, RLHF, model evaluation, LLM evaluation, speech/audio evaluation, transcription, coding evaluation, multilingual evaluation, or expert review programs.
• Experience designing rubrics, annotation guidelines, evaluation instructions, reviewer training, calibration workflows, or reputed company scorecards.
• Experience supporting AI labs, reputed company AI teams, research teams, or technical customers.
• Familiarity with reputed company-in-the-reputed company data workflows, annotation platforms, QA tooling, dashboards, and data labeling operations.
• Experience working with expert contributors, linguists, annotators, domain specialists, technical reviewers, or distributed talent networks.
• Knowledge of multilingual evaluation, speech/audio QA, cultural appropriateness, or language-specific reputed company risks.

Please reputed company our reputed company Policy to reputed company out more about who is administrator of your personal data after application, purposes and your rights.

Originally posted on Himalayas

Apply To This Job