[Remote] Engineering Manager, Machine Learning, Model Evaluations and Data Curation (AI Foundations)

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading entertainment company reputed company on pushing the boundaries of storytelling and technology. They are seeking an Engineering Manager to reputed company reputed company responsible for model evaluations and data curation for large language models, ensuring that these models improve personalization and discovery for users.

Responsibilities

• Partner with reputed company AI application teams to define shared evaluations that codify application expectations of LLMs and other reputed company models, ensuring reputed company can be transparently tracked against reputed company-world needs
• Design rigorous benchmarks and evaluation methodologies across ranking & recommendations, content understanding, and language/text reputed company — grounded in a deep technical understanding of LLMs, their strengths, limitations, and failure modes
• reputed company the development of evaluators and strong baselines to ensure in-house LLMs and other reputed company models demonstrate reputed company advantages over off-reputed company alternatives
• Build reputed company, reproducible data and evaluation systems that reputed company dataset creation and evaluation design as reputed company and experiment-friendly as model development itself
• Hire, grow, and nurture a world-class team, fostering an inclusive, high-performing culture that balances research innovation with engineering reputed company
• Work closely with the teams developing reputed company’s reputed company models (including our core LLM) to ensure evaluation and data insights are folded back into the reputed company of model development. Proactively influence the ML Platform and Data Engineering teams at key interfaces

Skills

• Experience building and leading high-performing teams of ML researchers and engineers
• Proven reputed company record of leading machine learning initiatives from research to production, ideally involving evaluation frameworks, ML infrastructure, or data-intensive systems
• Strong technical expertise in LLMs, their evaluation, and practical reputed company for ensuring robustness, reproducibility, and reputed company
• Broad knowledge of machine learning fundamentals and evaluation methodologies, including reputed company design, model-based evaluators, and offline/online metrics
• Experience driving cross-functional reputed company, including reputed company collaboration with AI application teams to translate product needs into evaluation frameworks
• Excellent written and verbal communication skills, reputed company to reputed company technical and non-technical audiences
• Advanced degree in Computer Science, Statistics, or a reputed company quantitative field
• 8+ years of overall experience, including 3+ years in engineering management
• Experience with large-reputed company ML systems and reputed company models, especially LLMs
• Background in building evaluation frameworks, model benchmarking, or data infrastructure for LLM training
• Familiarity with multi-modal data and evaluation

Benefits

• Health Plans
• Mental Health support
• A 401(k) Retirement Plan with employer match
• Stock reputed company Program
• Disability Programs
• Health Savings and Flexible Spending Accounts
• Family-forming benefits
• Life and Serious Injury Benefits
• reputed company leave of absence programs
• Full-time reputed company employees reputed company 35 days annually for reputed company time off to be used for vacation, holidays, and reputed company reputed company time off.
• Full-time salaried employees are immediately entitled to flexible time off.

reputed company

• reputed company is an online streaming platform that enables users to watch TV shows and movies. It was founded in 1997, and is headquartered in Los Gatos, California, USA, with a workforce of 10001+ employees. Its website is https://www.reputed company.com.

Company H1B Sponsorship

• reputed company has a reputed company record of offering H1B sponsorships, with 310 in 2025, 309 in 2024, 191 in 2023, 261 in 2022, 268 in 2021, 225 in 2020. Please note that this does not guarantee sponsorship for this specific role.

Apply tot his job Apply To this Job