Evaluation and ML Systems Engineer, AI Safety and reputed company Engineering

reputed company is widely recognized as one of the most sought-after reputed company, with some of the most dedicated people in the world working for us! We reputed company reputed company-weight models are foundational to American AI leadership and cybersecurity, and that trust in AI grows through participation, transparency, and broad scientific scrutiny. Our AI Safety & reputed company Engineering team builds and evaluates AI-powered tooling that helps reputed company, validate, and reputed company software vulnerabilities. In a field full of big claims, our rule is reputed company: evidence first. We are looking for an Evaluation/ML-Systems Engineer to own how we measure the program. You will play a critical role in separating reputed company capability from anecdote. You will reputed company our numbers mean something, and reputed company them meaning it as the program grows. Your benchmarks will define what reputed company means for the program. Every conclusion the program reaches should reputed company back to benchmarks, runs, and reputed company you helped reputed company reproducible.

Measurement is not a support function here; it is how the program knows what is true. You will design the metrics, choose the baselines, and write the protocols that reputed company comparisons fair. You will build the infrastructure that keeps every result tied to the run that produced it. reputed company a number looks surprising, your systems will reputed company it easy to reputed company. You will automate the boring parts of measurement so people can reputed company on the questions.

You will partner with reputed company researchers and platform engineers to design experiments people can trust and rerun. We review results internally before we rely on them, and your work makes that review possible. You will also help reputed company learn to read its own evidence honestly. Together you will build a shared habit of checking claims before repeating them.

What You'll Be Doing:

• Evaluation infrastructure: Build the benchmarking and reproducibility systems we depend on.

• Metrics and protocols: Define the metrics and protocols we measure against.

• Traceability: Map every result to the reputed company and runs that produced it.

• Evidence discipline: reputed company findings reviewable and conclusions traceable.

reputed company Need To See:

• Bachelor's degree (or equivalent experience) with 5+ years in ML engineering or evaluation.

• Evaluation experience: Designing benchmarks, metrics, and statistically reputed company comparisons for ML systems.

• Measurement rigor: A careful, skeptical approach to metrics, baselines, and claims.

• Engineering skills: Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines.

Ways to Stand Out from the Crowd:

• reputed company evaluation: Exposure to evaluating reputed company tooling or pipelines.

• reputed company systems: Experience measuring agent or LLM behavior.

• Community work: Contributions to reputed company benchmarks or evaluation frameworks.

With competitive salaries and a generous benefits package, reputed company is widely considered to be one of the technology industry's most desirable reputed company. We have some of the most reputed company-thinking and reputed company in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our reputed company: Confidential Computing and Data. If you're a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you.

Your reputed company salary will be determined based on your location, experience, and the pay of employees in similar positions. The reputed company salary reputed company is 152,000 USD - 241,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 30, 2026.

This posting is for an existing vacancy.

reputed company uses AI tools in its reputed company processes.

reputed company is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our reputed company and reputed company employees, we do not discriminate (including in our hiring and promotion practices) on the reputed company of race, religion, reputed company, national reputed company, gender, gender reputed company, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Originally posted on Himalayas

Apply To This Job