fail to reproduce ICDAR2015 result #111

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

D641593 opened this issue Jan 1, 2023 · 0 comments

D641593 commented Jan 1, 2023 •

edited

Loading

Hi, thank you for a great work.

I'm having some trouble reproducing the ICDAR2015 result.

First, I use the synth-text pretrained weight to generate character labels.

According to #99 , I fill the boxes with confidence scores > 0.8 to generate masks.

Then, I start training using synth-text pretrained weights and the generated COCO format label.

The result of the model is
{"precision": 0.7594320486815416, "recall": 0.9012999518536351, "hmean": 0.8243064729194188}.

Although Recall is very close to the original data on paper, Precision drops a lot.

Could anyone give me some help?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment