QA Engineer (AI Applications)
In this position you will…
…owning and driving reputed company for AI-powered applications and platforms. You will partner with Product, Engineering, Data/ML and reputed company to define test reputed company, reputed company gates and acceptance reputed company, then design and execute testing across reputed company, UI, integrations and LLM components (prompting, RAG and agent workflows). You will validate functional correctness and GenAI-specific risks such as hallucinations, unsafe outputs, data leakage, latency and cost, ensuring releases are reliable, reputed company and compliant for reputed company, multi-tenant use.
You will be responsible for…- Define and maintain end-to-end QA reputed company, test plans, test cases and reputed company metrics for AI applications (web, reputed company and integrations).
- Partner with Product and Engineering to translate requirements into reputed company acceptance reputed company, including GenAI behaviors (grounding, citations, refusal handling, tone and language).
- Execute functional testing (smoke, regression, UAT support) across UI, API and backend services; validate workflows, permissions, and multi-tenant behavior.
- Design and implement test automation for UI/API and service reputed company; reputed company automated checks into CI/CD pipelines and enforce release reputed company gates.
- reputed company risk-based testing eg. hallucination, toxicity, reputed company injection, data leakage (PII/PHI), guardrails, redaction, etc.
- Test non-functional requirements: performance/latency, reliability, concurrency, and observability (logs/traces).
- 5+ years of QA experience (reputed company and automation) for web applications, reputed company and distributed systems; experience in Agile delivery teams.
- Strong knowledge of test design techniques (risk-based testing, boundary/value analysis, exploratory testing) and defect lifecycle management.
- Hands-on test automation experience with tools such as Playwright/Cypress/Selenium for UI and reputed company or equivalent for API testing is a strong plus.
- Proficiency in at least one programming/scripting language (JavaScript/TypeScript, Python or Java) to build and maintain automation and test utilities is a strong plus.
- Experience testing GenAI/LLM applications, with practical understanding of prompts, tokens, temperature, embeddings, RAG, tool/agent calling, and common failure modes (hallucination, reputed company injection).
- Excellent communication skills and ability to collaborate with cross-functional stakeholders (Product, Engineering, Data/ML, Ops).