How do I reproduce the results of the rvos report？

[xinbaiw]

The inference is that the model being called is DEVA-propagation.pth? I used this model to infer the J&F on the rvos task, which is 64.8. The one reported in the paper is 66.0. Can you help me find out where I went wrong?

[xinbaiw]

The inference is that the model being called is DEVA-propagation.pth? I used this model to infer the J&F on the rvos task, which is 64.8. The one reported in the paper is 66.0. Can you help me find out where I went wrong?

[hkchengrex]

Can you compare your output with our pre-computed one and see if there is any discrepancy? It should reproduce exactly. There is too little information here for me to look into it.

[xinbaiw]

Can you compare your output with our pre-computed one and see if there is any discrepancy? It should reproduce exactly. There is too little information here for me to look into it.

Can you find anything wrong with these details？

parser.add_argument('--mask_path', default='/home/data2/Ref-YouTubeVOS-ReferFormer-SwinL-detections')
parser.add_argument('--model', default='./saves/DEVA-propagation.pth')
parser.add_argument('--img_path', default='/home/data2/rvos/valid/JPEGImages')

[xinbaiw]

Hi, can you help me?

[hkchengrex]

I cannot peek into your file system and know what is in each folder. One potential reason is that you are not using all the frames in YouTubeVOS (i.e., https://drive.google.com/drive/folders/16uw2j3o8Pi2xhvgGopYMKyjKtzV9RQ6c)

[xinbaiw]

I cannot peek into your file system and know what is in each folder. One potential reason is that you are not using all the frames in YouTubeVOS (i.e., https://drive.google.com/drive/folders/16uw2j3o8Pi2xhvgGopYMKyjKtzV9RQ6c)

Thank you for your reply. When I used all frames of youtube-vos to test, out of memory, single card 4090 (24g), do you have a solution?

[xinbaiw]

How to reduce memory usage when testing?

[hkchengrex]

See here https://github.com/hkchengrex/Tracking-Anything-with-DEVA/blob/main/docs/EVALUATION.md#general-arguments

Use --amp

[longmalongma]

See here https://github.com/hkchengrex/Tracking-Anything-with-DEVA/blob/main/docs/EVALUATION.md#general-arguments

Use --amp

After using amp, the memory is still not enough. Is there any other way?

[longmalongma]

See here https://github.com/hkchengrex/Tracking-Anything-with-DEVA/blob/main/docs/EVALUATION.md#general-arguments
Use --amp

After using amp, the memory is still not enough. Is there any other way?

Why does the test go out or memory at a later stage?

[wqqqqq0720]

推断是调用的模型是 DEVA-propagation.pth？我用这个模型推断了 rvos 任务上的 J&F，是 64.8。论文中报告的是 66.0。你能帮我找出我错在哪里吗？

hi，Can you tell me how to submit the result, I have not responded after clicking submit.