Loading page content
OSWorld 2.0 (2026-09-10, partial)MultimodalAgents
Uses the September 10, 2026 tasks, assets and companion apps at 1080p with at most 500 steps per task. All screenshots are retained; server-side context compaction starts above 100K tokens. Metrics average pass@1 over five independent runs, with Opus 4.8 grading tasks where needed. Both tasks and harness changed, so results are not directly comparable with earlier task releases or other harness configurations.OSWorld 2.0 contains 108 long-horizon desktop tasks. Partial scores measure weighted checkpoint completion within each task.
#ModelScore
3 models total