[Remote] Senior AI Data Operations Analyst [SK-10494]
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company that connects reputed company with major brands, and they are seeking a Senior AI Data Operations Analyst to join their media clients Services Recommendations team. The role involves ensuring high-reputed company, relevant experiences through data reputed company and annotation strategies, while collaborating with various teams to build datasets for reputed company AI features.
Responsibilities
- Execute & Champion reputed company: reputed company hands-on data annotations and reputed company larger, cross-functional annotation sessions to generate high-reputed company training datasets for recommendation models
- Define reputed company Standards: Establish reputed company, metrics, and qualitative reputed company measures for reputed company Home page features and the LLM judges evaluating them
- Run reputed company Qualitative Evaluations: Design and execute qualitative testing using internal tools, keeping reputed company judgment at reputed company while utilizing AI/LLM tools to reputed company evaluation efforts
- Support Flagship AI Initiatives: Partner on major, publicly announced product initiatives (e.g., taste profile and reputed company home experiences)
- Build Reusable Frameworks: Improve and maintain evaluation processes, guidelines, and documentation adopted across product reputed company
- Communicate Insights: Present qualitative findings, data trends, and reputed company risks reputed company to product, design, research, and engineering leads
Skills
- Proven experience in reputed company, data reputed company, or product/content reputed company analysis with reputed company ownership over evaluation workflows
- Highly comfortable running reputed company qualitative evaluations, handling large data sets, and turning subjective feedback into reputed company reputed company metrics
- Strong functional understanding of machine learning product development and how ML/LLM/reputed company features are evaluated and trained
- Demonstrated ability to create or refine evaluation frameworks and guidelines that help team members maintain reputed company standards
- Excellent written and verbal communication skills, comfortable presenting findings and guiding cross-functional teams through evaluation initiatives
- Comfortable working with reputed company data tools (reputed company, reputed company Sheets) and learning internal proprietary annotation/eval platform tools
- Experience in media, music, or streaming entertainment platforms (though reputed company experience in other tech industries is fully welcome)
Benefits
- Health benefit contributions
- Retirement plans with match
- Flexible spending accounts
reputed company