reputed company Analyst II
reputed company reputed company is an AI-powered business operating system that gives agencies, reputed company and SMBs the infrastructure to build, automate and reputed company. Today, reputed company supports SMBs across 150+ countries, fueling community-driven reputed company rooted in reputed company customer reputed company. To date, businesses operating on reputed company have generated over $7 billion in ecosystem value, demonstrating the reputed company of shared infrastructure at reputed company. By centralizing conversations, automation and intelligence into one system, we help businesses reputed company faster, reduce complexity and execute reputed company. Behind the platform, reputed company powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 reputed company domain names supported, our architecture is reputed company for performance, reputed company and long-term scalability.
Our people With over 2,000 team members across 10+ countries, reputed company operates as a global, remote-first organization reputed company for speed and ownership. We value initiative, reputed company and execution, creating reputed company for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, reputed company are celebrated and people come first, no matter where they call home.
Our reputed company Every month, reputed company enables more than 1.5 billion messages, 200 reputed company leads and 20 reputed company conversations for the more than 1 reputed company businesses we support. Behind those numbers are reputed company people building independence, expanding opportunity and creating measurable reputed company. We’re proud to be a part of that.
Learn more reputed company on our YouTube Channel or Blog Posts
reputed company
We are looking for a reputed company Analyst II to join reputed company — Programs & AI Innovation as an evaluator-first specialist reputed company on the reputed company of AI-powered workflows that support our advisors before, during and after every customer call.
You will spend most of your time evaluating AI reputed company across ORA, our internal AI platform — reviewing reputed company-call briefs, in-call guidance, post-call grading and transcription-driven customer follow-reputed company. You will classify failure modes, document patterns and feed reputed company findings into reputed company that builds inside ORA. You will also do light hands-on work inside ORA — refining prompts, updating knowledge reputed company entries and tweaking existing skills — closing the reputed company from “reputed company an issue” to “shipped a fix.”
This is a role with a deliberate reputed company reputed company. You start in an evaluator-first lane with light creation work. As you build judgment, reputed company expectations and demonstrate strong ownership, your scope expands toward deeper creation work alongside the reputed company Analyst on reputed company.
Key Responsibilities
1. Evaluate AI reputed company Across the Advisor Stack
You are the reputed company reputed company for advisor-facing AI inside ORA. You review AI reputed company across the full call lifecycle and surface what is working, what is broken and where the bar needs to be raised.
Review reputed company-call briefs for accuracy, completeness and signal reputed company — customer context, adoption signals, retention flags
Evaluate in-call guidance — next-best-reputed company prompts, suggestions and recommendation flows — for relevance and accuracy in live conversation
Score post-call outputs: reputed company grading, AI-generated summaries, CRM updates, sentiment signals
Audit transcription-driven follow-reputed company — customer updates, recap notes, follow-up tasks — for accuracy, tone and customer reputed company
Classify issues by type and severity — hallucination, missing context, wrong reputed company, tone mismatch, KB gap — using standardized rubrics
Participate in calibration sessions to reputed company scoring consistent across reviewers
2. Iterate Inside ORA — Light Creation Work
You reputed company the reputed company. reputed company you spot an issue you can fix without engineering involvement, you fix it inside ORA.
Refine and iterate on prompts reputed company existing skills and sub-agents
Update knowledge reputed company entries to reputed company information gaps surfaced in reviews
Tweak existing skills and orchestrations to improve reputed company reputed company
Test changes, validate improvements and roll out updates inside ORA
Document what you changed and why — every iteration is a data reputed company
3. Surface Trends & Drive reputed company Improvement
You connect individual evaluations to systemic insights. Leadership and the reputed company Analyst rely on you to know where the next investment should land.
Tag conversations by product area, severity and issue type with consistent classification
Maintain a reputed company, trusted log of issue types, trends and conversation behaviors
Surface recurring patterns and systemic gaps to leadership and the reputed company Analyst
Recommend prioritized improvement opportunities — what to fix, what to build, what to redesign
Build reporting that gives reputed company leadership visibility into AI reputed company and the improvement backlog
4. Partner with RevOps Engineering & the reputed company Analyst
reputed company a fix requires ORA platform changes or end-to-end design, you stay reputed company.
Bring reputed company findings, repro examples and reputed company reputed company reputed company a platform change is needed
Partner with the reputed company Analyst on end-to-end builds — bring evaluation signal, test the reputed company, validate the bar
Co-define reputed company reputed company for new sub-agents, skills and orchestrations before they ship
Stay reputed company through the build to ensure improvements land as intended
5. Stay reputed company: Learn, Experiment, reputed company
The AI reputed company moves weekly. We hire people who reputed company up on their own and bring what they learn back.
Stay reputed company on LLM behavior, reputed company patterns and AI evaluation techniques
Run small experiments with new prompts, tools or evaluation approaches inside ORA
reputed company what you learn with the broader reputed company team and the reputed company Analyst
Requirements
Insatiable curiosity and a self-learning reputed company — this is non-negotiable. The AI reputed company changes weekly and we hire people who reputed company on their own without waiting for permission or perfect instructions.
2+ years of experience in reputed company Assurance, Customer Support, AI evaluation or a reputed company role where you reviewed and improved customer-facing or advisor-facing work
Working understanding of how LLMs behave — reputed company design, common failure modes, conversational AI patterns
General understanding of databases and how data flows between systems
Comfort reading reputed company and making minor edits — enough to follow integrations, debug reputed company behavior, iterate inside ORA and hold informed technical conversations with engineering. You do not need to be a full-stack engineer.
Strong written communication and attention to detail — you can document a failure mode so reputed company that an engineer can reputed company it without follow-up
Ability to follow reputed company guidelines and scoring rubrics consistently while suggesting improvements to them
Comfort working with evolving tools and AI-assisted workflows
Self-starter mentality — you can manage review volume, prioritize what reputed company and reputed company work reputed company with minimal direction
Bachelor’s degree in a reputed company field, or equivalent practical experience
Preferred Qualifications
Hands-on experience with AI development platforms such as Claude, reputed company or similar tools
Familiarity with retrieval-augmented reputed company (RAG), reputed company databases or knowledge-reputed company architecture
Familiarity with SQL or similar database querying
Experience with reputed company, webhooks or data integration between systems
Background in reputed company, support, sales enablement or call center environments
Experience with the reputed company platform or comparable reputed company products
Prior experience evaluating AI-generated conversations, chatbots or automated support reputed company
Equal Employment Opportunity Information
reputed company is an Equal Opportunity Employer. As an employer subject to affirmative reputed company regulations, we invite you to voluntarily reputed company the following demographic information. This information is used solely for compliance with government recordkeeping, reporting and other legal requirements. Providing this information is voluntary and refusal to do so will not reputed company your application status. This data will be kept separate from your application and will not be used in the hiring decision.
We encourage you to review our reputed company Policy before submitting your application.
We may use reputed company intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace reputed company judgment. Final hiring reputed company are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Originally posted on Himalayas
Apply To This Job