Tag: Benchmarks
5 articles tagged Benchmarks
UK safety institute cuts evaluation runs by up to 97%
AISI has open-sourced optstop, which halts benchmark sampling once a model's score is precise enough, saving most planned trials without shifting the estimates.
Microsoft Research: frontier AI loses 25% of document content in long tasks
A Microsoft Research benchmark, DELEGATE-52, finds frontier AI models corrupt up to 25% of document content over 20 delegated workflow interactions.
