Appgithub-com-open-compass-vlmevalkit

Download Pinokio

Sign in Create accountJoin

Sign in Create accountJoin

VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

github.com/open-compass/VLMEvalKitUpdated 6mo ago

Repository details

Updated 2026-03-27T07:51:21.000Z

Indexed 2026-03-31T16:01:26.440Z

Loading community details…

Loading project activity…

Community

Sort byCreate post

Ask or share about VLMEvalKit…

Loading...

Pinokio

Projects using this repository

No references listed yet.

Check-ins (0)

No check-ins yet.

Recent commits

[Benchmark] Add support for MMOral-OPG-Closed benchmark (#1483)

Jing HAO6 months agoa3656d4

[Benchmark] Add support for MMOral-OPG-Open benchmark (#1484)

Jing HAO6 months ago589fe36

[Lint] Standardize code style and logger usage. (#1493)

Ma Zerun6 months ago401916c

[Fix] Fix ChartX Evaluation Robustness. (#1489)

Jinsong Li6 months agof67e576

[Benchmark] Add support for MMSafetyBench, XSTest, MMSBench, Flames, SIUO and M3oralBench. (#1488)

Gu tian7 months ago6e7e372

[Feature] add MiniMax as text LLM API provider (#1491)

Octopus7 months agof91760e

[Benchmark] Support SArena Benchmark (#1371)

Yifei Li7 months ago7d6d81f

[Update] Update model settings for 2026.2 live leaderboard. (#1492)

Ma Zerun7 months ago655e65f

[Benchmark] Support ChartBench. (#1490)

Jinsong Li7 months agof765748

[Feature] Support sequential inference accorss all datasets and parallel evaluation. (#1487)

TianhaoLiang20007 months ago4baeeee