- h
MMMU
- huggingface.co
Updated Dec 4, 2023
Share
Facebook
Twitter
EmailClick to copy linkLink copiedCiteMMMU (2023). MMMU [Dataset]. https://huggingface.co/datasets/MMMU/MMMUCroissantCroissant is a format for machine-learning datasets. Learn more about this at mlcommons.org/croissant.Dataset updatedDec 4, 2023Dataset authored and provided byMMMULicenseApache License, v2.0https://www.apache.org/licenses/LICENSE-2.0
License information was derived automaticallyDescriptionMMMU (A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI)
๐ Homepage | ๐ Leaderboard | ๐ค Dataset | ๐ค Paper | ๐ arXiv | GitHub
๐News๐ ๏ธ[2024-05-30]: Fixed duplicate option issues in Materials dataset items (validation_Materials_25; test_Materials_17, 242) and content error in validation_Materials_25. ๐ ๏ธ[2024-04-30]: Fixed missing "-" or "^" signs in Math dataset items (dev_Math_2, validation_Math_11, 12, 16; test_Math_8โฆ See the full description on the dataset page: https://huggingface.co/datasets/MMMU/MMMU.
- h
mmmu-pro-vision
- huggingface.co
ShareFacebookTwitterEmailClick to copy linkLink copiedCiteLZX, mmmu-pro-vision [Dataset]. https://huggingface.co/datasets/zli12321/mmmu-pro-visionAuthorsLZXLicenseApache License, v2.0https://www.apache.org/licenses/LICENSE-2.0
License information was derived automaticallyDescriptionzli12321/mmmu-pro-vision dataset hosted on Hugging Face and contributed by the HF Datasets community
- h
VideoMMMU
- huggingface.co
- aifasthub.com
Updated Feb 11, 2025ShareFacebookTwitterEmailClick to copy linkLink copiedCiteLMMs-Lab (2025). VideoMMMU [Dataset]. https://huggingface.co/datasets/lmms-lab/VideoMMMUDataset updatedFeb 11, 2025Dataset authored and provided byLMMs-LabDescriptionThis dataset contains the data for the paper Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos. Video-MMMU is a multi-modal, multi-disciplinary benchmark designed to assess LMMs' ability to acquire and utilize knowledge from videos. Project page: https://videommmu.github.io/
Leaderboard (last updated: 07 Feb, 2025)Model Overall Perception Comprehension Adaptation ฮknowledge
Human Expert 74.44 84.33 78.67 60.33 +33.1โฆ See the full description on the dataset page: https://huggingface.co/datasets/lmms-lab/VideoMMMU.
Not seeing a result you expected?
Learn how you can add new datasets to our index.
FacebookTwitterEmailApache License, v2.0https://www.apache.org/licenses/LICENSE-2.0
License information was derived automatically
MMMU (A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI)
๐ Homepage | ๐ Leaderboard | ๐ค Dataset | ๐ค Paper | ๐ arXiv | GitHub
๐News
๐ ๏ธ[2024-05-30]: Fixed duplicate option issues in Materials dataset items (validation_Materials_25; test_Materials_17, 242) and content error in validation_Materials_25. ๐ ๏ธ[2024-04-30]: Fixed missing "-" or "^" signs in Math dataset items (dev_Math_2, validation_Math_11, 12, 16; test_Math_8โฆ See the full description on the dataset page: https://huggingface.co/datasets/MMMU/MMMU.