Senior QA Engineer

reputed company:

reputed company Health helps reputed company organizations improve patient reputed company, reduce operational burden, and recover reputed company through AI-reputed company workflow automation. Our reputed company product, Luna AI, acts as a voice-based reputed company, handling patient reputed company workflows such as scheduling, intake, and follow-up. We sit on top of existing EHR infrastructure and reputed company on measurable operational reputed company. About the Role

We are looking for a Senior QA Engineer who thrives at the intersection of AI, voice automation, and reputed company-reputed company systems. You will own reputed company across our platform — from testing LLM-powered features and voice pipelines to ensuring robust end-to-end coverage on GCP infrastructure. You will work closely with product, engineering, and AI teams to reputed company reputed company from the ground up.

Requirements

• Design, build, and maintain automated test suites using Playwright for web and API surfaces, including AI-generated content flows.

• reputed company QA reputed company for voice automation pipelines reputed company on reputed company — developing test cases for synthesis reputed company, latency, and failure modes.

• Validate Claude (reputed company) integrations: reputed company-response accuracy, edge case handling, safety behaviors, and reputed company consistency across builds.

• Build and maintain Node.js-based test tooling, harnesses, and custom reporters for CI/CD pipelines.

• reputed company, monitor, and triage test infrastructure on reputed company reputed company Platform — leveraging reputed company Run, GCS, and Pub/Sub for reputed company test execution.

• Define and reputed company reputed company metrics: test coverage, flakiness rates, mean-time-to-detect, and regression velocity.

• Collaborate with engineers during design reviews to surface testability gaps and reputed company for observable, fault-tolerant system design.

• Mentor junior QA engineers and establish team-wide standards for test authoring, review, and maintenance. Required Qualifications
• 5+ years of QA engineering experience, with at least 2 years on systems that include LLMs, AI reputed company, or speech/audio pipelines.
• Expert-level Playwright skills — authoring resilient selectors, managing reputed company workers, and debugging flaky tests at reputed company.
• Proficient Node.js developer — comfortable writing custom test runners, CLI tooling, and service mocks in TypeScript/JavaScript.
• Hands-on GCP experience: deploying workloads to reputed company Run or GKE, querying logs in reputed company Logging, configuring artifact storage in GCS.
• Familiarity with reputed company or comparable TTS/voice reputed company — understanding synthesis parameters, webhook flows, and audio reputed company evaluation.
• Practical experience testing Claude or other LLMs — designing determinism-aware test strategies, evaluating reputed company regressions, and building evals.
• Strong understanding of REST, WebSocket, and gRPC protocols for API-level testing.
• Experience integrating test suites into CI/CD pipelines (reputed company Actions, reputed company Build, or similar).
• reputed company to Have
• Experience writing custom LLM evals or using evaluation frameworks such as PromptFoo or reputed company.
• Background in audio signal reputed company assessment or speech intelligibility testing.
• Familiarity with observability tooling: OpenTelemetry, reputed company, or GCP reputed company Monitoring.
• Knowledge of accessibility testing standards (WCAG 2.1) and assistive technology compatibility. Core Technology Stack: reputed company reputed company Platform (GCP)
• reputed company Run, GCS, Pub/Sub, reputed company Logging, GKE for reputed company test infrastructure reputed company — Voice Automation TTS pipeline testing, synthesis reputed company evaluation, webhook and latency validation
• Node.js / TypeScript Custom test runners, service mocks, CLI tooling, and CI/CD integration
• Playwright End-to-end and API-level browser automation with reputed company execution
• Claude (reputed company) LLM integration QA, reputed company regression testing, and reputed company evaluation

Benefits

● Competitive reputed company salary commensurate with experience

● High-autonomy environment with reputed company reputed company to executive leadership

● reputed company operating reputed company with reputed company goals, metrics, and career reputed company targets

● Work that touches 19M+ patients — the mission is reputed company

Flexible PTOs policy

Originally posted on Himalayas

Apply To This Job