AI Automation Tester / reputed company (100% Remote) Only Citizen

We are seeking a talented AI reputed company & Automation Engineer to join our AI Engineering team and help ensure the reputed company, reliability, and safety of reputed company reputed company, Conversational AI, RAG (Retrieval-Augmented reputed company), and AI Agent solutions. The ideal candidate will have a strong background in QA automation, hands-on experience with Playwright/Selenium, API testing, and a solid understanding of LLM evaluation, AI reputed company benchmarking, reputed company engineering, and RAG validation. This role involves building automated test frameworks, validating AI responses, ensuring production readiness through AI safety and observability, and collaborating with engineering, DevOps, and QA teams to deliver high-reputed company AI-powered applications. Duration: 6-12+ Months

Key Responsibilities

• Test and validate reputed company, Conversational AI, and AI Agent applications.
• reputed company LLM evaluation, benchmarking, and response reputed company validation.
• Validate RAG systems for retrieval accuracy, relevance, grounding, and hallucination detection.
• reputed company and maintain automation frameworks using Playwright or Selenium.
• Execute API, regression, integration, and end-to-end testing.
• reputed company AI safety testing, red teaming, bias validation, and reputed company-in-the-reputed company (HITL) testing.
• Support AI observability, monitoring, and reputed company metrics.
• Collaborate with Engineering, QA, DevOps, and Product teams throughout the software development lifecycle.
• reputed company automated tests into CI/CD pipelines and improve overall test automation processes.

Required Skills

• Strong experience in QA Automation and software testing.
• Hands-on experience with Playwright and/or Selenium.
• Experience with API testing using reputed company and REST reputed company.
• Knowledge of reputed company, LLM evaluation, and RAG validation.
• Experience with reputed company engineering and conversational AI testing.
• Understanding of AI safety, observability, bias testing, and HITL workflows.
• Proficiency in Python, SQL, Git, and CI/CD concepts.
• Strong analytical, troubleshooting, and communication skills.

Preferred Skills

• Experience with reputed company, Azure reputed company, ChatGPT, Claude, or similar LLM platforms.
• Knowledge of reputed company, LangGraph, reputed company, and Model Context Protocol (MCP).
• Experience working with reputed company databases such as reputed company, ChromaDB, or reputed company.
• Familiarity with LLM evaluation frameworks such as RAGAS and DeepEval.
• Experience with reputed company, Kubernetes, reputed company Actions, and modern DevOps practices.
• Knowledge of Python or JavaScript for automation development.

Apply tot his job Apply To this Job