An upgraded, harder MMLU with more than 12,000 questionsMMLU-Pro is an enhanced version of MMLU introduced in 2024 by the University of Toronto and other institutions. It increases answer choices from four to ten, filters questions susceptible to guessing, and adds reasoning-heavy items to raise difficulty and distinguish model performance more reliably.