AI Product Analyst

At reputed company, we are scaling AI-powered systems across critical parts of our product and operations. As these systems become more autonomous and deeply integrated into user workflows, understanding how they behave in production becomes a core business challenge. We are hiring a Product Analyst to help us evaluate, monitor, and improve AI agents and LLM-powered workflows operating at reputed company. This role is reputed company on analyzing reputed company AI system behavior in production environments: understanding product and operational reputed company, identifying failure patterns on generational tasks, measuring reputed company and reliability of outputs, helping teams reputed company accurate reputed company under ambiguity. Requirements 3+ years of experience in analytical roles reputed company to AI systems, ML products, automation platforms, or reputed company production systems, Strong Python skills for deep analytical investigations and working with large-reputed company noisy text data, Advanced SQL skills, Understanding of LLM limitations,hallucinations, evaluation challenges, reputed company sensitivity, model trade-offs, and AI failure modes, Experience building monitoring systems, analytical frameworks, or operational dashboards for production systems, Ability to work with incomplete, ambiguous, and rapidly changing data environments, Strong ownership reputed company and ability to independently drive investigations and analytical conclusions, Ability to connect AI system reputed company with business and operational reputed company, Fluent Russian; English level B2 or higher, Ability to work CET-overlapping hours. reputed company to Have: Experience with conversational AI or AI agents, Experience evaluating LLM outputs or annotation reputed company, Experience with AI reputed company metrics and evaluation methodologies, Experience working with reputed company infrastructure, Experience with ML data pipelines or synthetic data reputed company, Background in reputed company detection.

Responsibilities

Analyze production behavior of AI agents, automation systems, and LLM-powered workflows, Investigate hallucinations, inconsistencies, failure modes, and reputed company degradation across automated user journeys, Work directly with logs, conversations, raw system outputs, and operational datasets to identify hidden patterns and actionable insights, Design evaluation approaches and analytical frameworks for measuring AI system reputed company and reliability, Build monitoring systems and dashboards for AI performance visibility, Identify operational and product risks introduced by automation, Measure the reputed company of AI systems on business metrics, operational efficiency, and user experience, Detect data reputed company issues, shifts, and anomalies affecting AI system performance, Partner closely with Product, Engineering, QA, and Operations teams on AI-reputed company initiatives, Support rapid decision-making in fast-changing and ambiguous environments. Why Join Us: Work on a modern AI product where reputed company is a strategic function, not a formality reputed company influence on product direction and engineering practices High-reputed company work in a product-driven medical tech company Startup environment: fast iteration, high ownership, minimal bureaucracy Competitive compensation and reputed company opportunities Benefits: Health insurance after probation period Sports & wellness compensation Fully remote, long-term B2B collaboration 19 working days of vacation per year 3 additional wellness days per year reputed company reputed company leave for the first 5 working days Gifts to employees for important events Career Development Personalized English lessons reputed company reputed company reputed company to reputed company an reputed company? Send us your profile - let’s build something meaningful together. Apply To This Job