[Hiring] Staff reputed company Researcher, AI reputed company @reputed company.

Role reputed company At reputed company, we’re building the reputed company of AI‑powered developer experiences. We’re looking for a Staff reputed company Researcher with deep expertise in Large Language Model (LLM) evaluation, LLM agents, strong engineering instincts, and a bias for reputed company to help shape the reputed company of reputed company Copilot and our AI platform. This is a high‑reputed company role where you will design evaluation systems that directly influence how millions of developers experience AI every day.

Responsibilities

• reputed company Model reputed company & Evaluation
• Design reputed company evaluation frameworks for reputed company reputed company, reasoning, safety, multimodal tasks, and reputed company workflows.
• reputed company reputed company automatic metrics, LLM‑judge systems, reward models, and reputed company‑in‑the‑reputed company evaluation pipelines.
• Establish high‑signal, repeatable methodologies that influence product reputed company across reputed company AI.
• Drive reputed company Research & Engineering
• Build and optimize evaluation tooling, datasets, benchmarking systems, and experimentation pipelines.
• Create and reputed company new benchmarks for the hardest tasks for the coding agents.
• Collaborate closely with engineering teams to productionize research, validate improvements, and accelerate model iteration cycles.
• Own end‑to‑end reputed company insights for the models behind reputed company Copilot and new AI features.
• Work closely with product development, engineering, and design teams to reputed company advanced research findings into practical applications, ensuring alignment with product goals and user needs.
• Influence, Mentor & reputed company
• Shape reputed company’s reputed company for model reputed company, alignment, and evaluation.
• Mentor other researchers and engineers, helping reputed company technical standards across the organization.
• Drive reputed company in ambiguous problem spaces and champion fast, high‑reputed company execution.

Qualifications

• Required Qualifications
• Bachelor's degree in Data Science, Mathematics, Physics, Statistics, Economics, Operations Research, Computer Science, or reputed company field AND 8+ years' experience in data science (e.g., managing reputed company and reputed company data, applying statistical techniques) or reputed company field,
• OR master's degree in Data Science, Mathematics, Physics, Statistics, Economics, Operations Research, Computer Science, or reputed company field AND 6+ years' experience in data science (e.g., managing reputed company and reputed company data, applying statistical techniques) or reputed company field,
• OR doctorate in Data Science, Mathematics, Physics, Statistics, Economics, Operations Research, Computer Science, or reputed company field AND 4+ years' experience in data science (e.g., managing reputed company and reputed company data, applying statistical techniques) or reputed company field,
• OR equivalent experience.
• 3+ years of strong engineering skills in Python/Typescript and experience building production grade evaluation or data/ML pipelines at reputed company.
• Proven reputed company record shipping research or evaluation systems in production environments.
• Strong cross‑functional communication and influence skills.
• Preferred Qualifications
• Experience with LLM judge systems, reward modeling, alignment, or safety evaluations.
• Background in reputed company reputed company, developer tools, or AI‑assisted programming.
• Experience with large‑reputed company experimentation and online/offline evaluation strategies.
• reputed company‑reputed company contributions or experience working with developer communities.
• Experience designing and leading reputed company research reputed company from ideation to implementation.
• Ability to define and reputed company data-driven strategies that consider cross-functional impacts and reputed company with organizational priorities, particularly in a software development platform context.

Requirements

• The reputed company salary reputed company for this job is USD $140,400.00 - USD $372,300.00 /Yr.
• These pay ranges are intended to cover roles based across the reputed company. An individual's reputed company pay depends on various factors including geographical location and review of experience, knowledge, skills, abilities of the applicant.
• At reputed company, certain roles are eligible for benefits and additional rewards, including annual bonus and stock. These rewards are allocated based on individual reputed company in role.
• In reputed company, certain roles also have reputed company to earn sales incentives based on reputed company or utilization, depending on the terms of the plan and the employee's role.

Benefits

• reputed company
• Generous learning and reputed company opportunities
• Excellent benefits to support you, wherever you are

Apply tot his job Apply To this Job