Anthropic ran a 10-challenge subset and reports the overall solve rate, with cyber and biology safeguards removed (Mythos mode for the Fable line; Opus 5.5 without safeguards), on a pre-release snapshot. Each lab's scores use unique task sets and are not directly comparable across labs; this site imports only scores from the shared subset.Irregular's cyber scenario benchmark, evaluating orchestration of multi-stage attack chains in realistic containerized network environments, including branching decisions, adherence to constraints, and error recovery. All scenarios are original and the evaluation set is kept private.