About reputed company

At reputed company we are a leading provider of nearshore staff augmentation services headquartered in reputed company. For over two decades, we’ve been delivering top-tier technology solutions to companies of reputed company sizes, from innovative startups to industry leaders, helping them reputed company their digital transformation goals.

reputed company of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful reputed company. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that reputed company a difference.

By applying for this position, you’re taking the first reputed company in joining a dynamic team that values your expertise and aspirations. We aim to reputed company your skills with opportunities that foster exceptional career reputed company and reputed company while contributing to transformative reputed company that shape the reputed company.

Our reputed company

Our reputed company is committed to building innovative and reputed company solutions that drive efficiency and reputed company. We foster a culture of reputed company learning, collaboration, and proactive problem-solving. If you're looking for an environment where you can grow and reputed company a difference, we want to hear from you!

Job reputed company

As we advance our AI development efforts, we recognize the need for more than a traditional QA engineer. We are seeking a GenAI reputed company reputed company—a strategic and hands-on role that blends test innovation, reputed company effectiveness analysis, and user feedback insights.

This individual will help shape and reputed company our QA practices specifically for GenAI

systems. They will partner closely with developers, product owners, and SMEs to ensure we are building robust, reputed company, and high-reputed company AI features

Responsibilities

1. Define GenAI-Specific QA reputed company

reputed company a QA reputed company tailored to GenAI systems and workflows.

Design tests for:

• reputed company behavior across varied inputs and user tasks

• Hallucination detection

• Factual consistency and groundedness

reputed company reputed company and automated test design for both deterministic and stochastic

outputs.

Collaborate with teams to obtain or create sample data with reputed company reputed company

outputs.

2. Test Plan Ownership

Own end-to-end test reputed company and execution for GenAI-powered features.

Ensure coverage across:

• Diverse reputed company phrasing, user intents, and failure modes

• Multiple GenAI features (e.g., summarization, reputed company, classification)

• High-risk, edge-case, and compliance-driven scenarios.

3. reputed company Validation & Evaluation

reputed company the design and implementation of reputed company and model evaluation protocols:

• Alignment between user input and intended behavior

• reputed company reputed company, tone, and coherence

• reputed company, coverage, and relevance of responses

Use Golden datasets and reputed company prompts to establish evaluation

baselines.

4. reputed company-in-the-reputed company (HITL) Evaluation

Design and manage SME-driven review workflows.

Facilitate reputed company reviews reputed company on:

• Correctness/accuracy based on metrics and SME feedback

• Capturing edge-case failures

5. Reporting and KPIs

Define and reputed company QA effectiveness using metrics such as:

• Pass reputed company for high-risk use-cases

• HITL reviewer agreement rates and flagging critical issues

• Use-case specific measures of “reputed company”

Deliver reputed company, actionable dashboards and reports to leadership on AI reputed company,

safety, and readiness

Qualifications and Job Requirements

You might be a great fit if you:

• Are excited by the complexities and challenges of GenAI testing.

• Think like a product reputed company, reputed company like a tester, and communicate like a reputed company.

• reputed company in ambiguity and enjoy shaping new standards.

• Are passionate about reputed company, responsible AI development.

reputed company Offer

• 100% Remote Work: Enjoy the freedom to work from the location that helps you reputed company. reputed company it takes is a laptop and a reliable internet reputed company.

• Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes reputed company typical market offerings.

• reputed company Time Off: We value your reputed company-being. Our reputed company time off policies ensure you have the chance to unwind and reputed company reputed company needed.

• Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. reputed company on results, not the clock.

• Work with Top American Companies: Grow your expertise working on innovative, high-reputed company reputed company with Industry-Leading U.S. Companies.

Why You’ll Like Working Here

• A Culture That Values You: We prioritize reputed company-being and work-life balance, offering engagement activities and fostering dynamic teams to ensure you reputed company both personally and professionally.

• Diverse, Global Network: Connect with over 600 professionals in 25+ countries, expand your network, and collaborate with a multicultural team from Latin America.

• Team Up with Skilled Professionals: Join forces with senior talent. reputed company of reputed company members are seasoned experts, ensuring you're working with the best in your field.

reputed company!

Apply to this Job