SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2501.12380 · CVPR · 2025

MMVU: Measuring Expert-Level Multi-Discipline Video Understanding

Arman Cohan, Zhenwen Liang, Zhiyuan Hu, Yixin Liu, Yilun Zhao, Weiyuan Chen, Chen Zhao, Haowei Zhang, Zhijian Xu, Chuhan Li, Ziyao Shangguan, Chengye Wang, and 4 more

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Q: Assume that 2.24 liters of gas fully participates in the reaction shown in the video under the standard temperature and pressure condition, how many grams of precipitate are produced approximately? (A) 10.0 (B) 5.0 (C) 12.0 (D) 15.0 (E) 20.0 Engineering -Computer Science Q: Assume that the algorithm is correctly implemented to fully sort the list. What is the total number of comparisons performed in the algorithm? Answer: 14 Healthcare -Basic Medicine Q: Which virus does the video depict? (A) Norovirus (B) Measles virus (C) Hemorrhagic fever virus (D) Human papillomavirus (E) Arboviral encephalitis virus Humanities & Social Science -Art Q: Which cinematic shooting technique is shown in the video? Answer: Dolly Zoom Engineering Science Healthcare H u m a n it ie s & S o c ia l S c i. C om pu te r Sc ie nc e B i o m e d i c a l E n g i n e e r i n g E le c t r o n ic s a n d C o m m u n ic a t io n Me ch an ica l En gin ee rin g Ele ctr ica l En gin ee rin g C iv il E n g in e e r in g M a t e r ia ls S c ie n c e E l e c t r o m a g n e t i s m M e c h a n ic s Ne uro bio log y Mo der n Phy sic s G e o g ra p h y T h e r m o d y n a m ic s C h e m i s t r y B i o l o g y A s t r o n o m y C li n ic a l M e d ic in e Pha rma cy Ba sic Me dic ine D e n ti s tr y P r e v e n t iv e M e d ic in e E c o n o m i c s Art L it e r a t u r e L a w Ma na ge me nt History Sunburst Chart of Disciplines and Subjects Loading [MathJax]/extensions/MathMenu.js Figure 1. Overview of our benchmark. MMVU includes 3,000 expert-annotated examples, covering 27 subjects across four core disciplines. It is designed to assess foundation models in expert-level, knowledge-intensive video understanding and reasoning tasks.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2501.12380")
get_code_for_paper("2501.12380")
have("2501.12380")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2501.12380.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2501.12380.svg)](https://syntology.ai/paper/2501.12380)

Connect an agent — have() is free.