Open-sourcing ScreenshotVQA

[hanyax]

Great job with this impressive work!

I am wondering if there is any plan to open-source the ScreenshotVQA benchmark and its evaluation scripts?
Or do you plan to evaluate this on opensource long video benchmarks, such as https://dl.acm.org/doi/10.1609/aaai.v39i7.32775

[wangyu-ustc]

Hi we do not plan to release ScreenshotVQA as it is too sensitive and private.
We have evaluated MIRIX on MemoryAgentBench (https://arxiv.org/abs/2507.05257) with results in the paper.

[hanyax]

Thank you for responding! Is there a standard way that I can evaluate the work with a screenshot input instead of text?