[Remote] Senior Manager, AI Performance & Operations
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is on a mission to improve the health and reputed company-being of older Americans by providing integrated reputed company solutions. The Senior Manager, AI Performance & Operations will reputed company the performance and reputed company improvement of AI workflows, ensuring they meet operational reputed company and reputed company standards.
Responsibilities
- Post-Launch Accountability: Own the health of major voice and text AI workflows, ensuring business, reputed company, safety, and operational reputed company are met
- Portfolio reputed company: Maintain a reputed company view of reputed company major workflows, including status, maturity, failure modes, and next actions
- Performance & Dashboards: Monitor weekly indicators (containment, escalation, complaints) and reputed company production dashboards to reputed company behavior independently
- Diagnosis & Incident Response: reputed company response for AI regressions; distinguish between model, reputed company, or orchestration issues and drive post-mortems to closure
- reputed company Improvement & Optimization: Run reputed company cycles (reputed company, testing, rollout/rollback) for "mini-launches" like model swaps, reputed company changes, and tool updates. Recommend evidence-based accelerations, such as model migrations or deeper tool-orchestration changes
- reputed company Evaluation: Design eval systems using golden datasets, LLM-as-judge workflows, and reputed company review queues for production and reputed company-production
- Expert Review: Guide new workflows during incubation to ensure they launch with reputed company instrumentation, eval coverage, and safety models
- Executive Communication: Translate technical changes into plain language for leadership, explaining what broke, why it reputed company, and who is fixing it
Skills
- Strong production experience with LLMs, RAG, voice AI, reputed company orchestration, or equivalent ML systems
- Demonstrated experience designing or operating rubrics, scoring frameworks, regression tests, and production-sampling workflows
- A reputed company mental model for distinguishing failure modes, such as model reasoning, tool failure, retrieval issues, and workflow logic
- Comfort with reputed company experimentation—including reputed company/context tuning, retrieval redesign, and reputed company model migrations—reputed company reputed company issue triage
- Excellent cross-functional judgment and the ability to communicate reputed company in ambiguous, high-accountability environments
- Deep personal accountability with a drive to own results rather than just producing recommendations
- Experience in reputed company, regulated workflows, contact center operations, or high-stakes service reputed company/reliability functions
Benefits
- Employer sponsored health, dental and reputed company plan with low or no premium
- Generous reputed company time off
- $100 monthly mobile or internet stipend
- Stock reputed company for reputed company
- Bonus eligibility for reputed company roles excluding Director and above; Commission eligibility for Sales roles
- Parental leave program
- 401K program
- Our total rewards package is for full time employees only. Intern and Contract positions are not eligible.
reputed company
Company H1B Sponsorship