Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
28 Open 912 Closed
28 Open 912 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Benchmark] Add support for SciDocBench benchmark
#1511 opened Apr 10, 2026 by yuhangzang Collaborator Loading…
[Benchmark] Add Support for LVOmniBench
#1510 opened Apr 9, 2026 by KD-TAO Loading…
fix(docs): fix broken anchor links in zh-CN and ja README navigation
#1507 opened Apr 3, 2026 by qyangcv Loading…
3
[Benchmark] Add support for MaXM
#1505 opened Apr 2, 2026 by inigopm Contributor Loading…
[Benchmark] Add support for MaRVL, xGQA and ALM-Bench
#1504 opened Apr 2, 2026 by inigopm Contributor Loading…
1
[Benchmark] Fix problems found in XSTest, M3oralbench, MSSBench, MMSafetyBench, Flames and SIUO_GEN.
#1503 opened Apr 1, 2026 by Gugugugugutian Contributor Loading…
[Fix] fix MathCanvas-Bench md5 & summarize_mathcanvas_results
#1502 opened Mar 31, 2026 by shiwk24 Contributor Loading…
3
add Ming-flash-omni-2.0
#1501 opened Mar 30, 2026 by OMRailgun Contributor Loading…
fix the vladbench download bug
#1497 opened Mar 25, 2026 by Depth2World Contributor Loading…
2
[Benchmark] Add MMRarebench dataset support
#1495 opened Mar 23, 2026 by junzhin Loading…
1
[Benchmark] Add support for MedQ-DEG-Bench
#1482 opened Mar 16, 2026 by liujiyaoFDU Contributor Loading…
2
[Model] Support for llava hf
#1479 opened Mar 11, 2026 by smgjch Loading…
2
[API] Add DeepOCR pipeline API provider
#1473 opened Mar 4, 2026 by leejooan Loading…
3
jt video chat v260227
#1460 opened Feb 28, 2026 by jiutiancv Contributor Loading…
1
Fix LLaVA model output issues by using official conversation templates WIP
#1424 opened Feb 2, 2026 by cdllI Loading…
3
[Benchmark] Support ScienceOlympiad Galaxy10DECaLS VRSBench
#1410 opened Jan 21, 2026 by zhouyujin Loading…
2
[Benchmark] Support OmniBench
#1327 opened Nov 26, 2025 by jmlee4967 Loading…
[Benchmark] Support VP-Bench in Image MCQ WIP
#1322 opened Nov 23, 2025 by Endlinc Loading…
1
Request to add SIBench evaluation code
#1310 opened Nov 9, 2025 by song2yu Loading…
4
add support for internvideo, videollama, keye and llava-onevision-1.5 WIP
#1244 opened Sep 22, 2025 by FangXinyu-0913 Collaborator Loading…
@FangXinyu-0913
1
[major] add tsv, xlsx, json fo PRED_FORMAT and csv, json for EVAL_FORMAT
#1172 opened Jul 20, 2025 by OliverLeeXZ Collaborator Loading…
[Model] Add new model provider: AI/ML API
#1093 opened Jun 19, 2025 by D1m7asis Loading…
4 tasks done
3
WIP: Add Capture Dataset WIP
#974 opened May 2, 2025 by bodsul Loading…
2
fix(image_mcp.py): use consistant argument (#929)
#968 opened Apr 28, 2025 by MaoSong2022 Collaborator Loading…
1
2
[Minor] Align MMMU evaluation method with official Pending
#966 opened Apr 28, 2025 by FangXinyu-0913 Collaborator Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.