Skip to content

Model Settings and checkpoint not match #32

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
z-jiaming opened this issue Nov 9, 2023 · 0 comments
Open

Model Settings and checkpoint not match #32

z-jiaming opened this issue Nov 9, 2023 · 0 comments

Comments

@z-jiaming
Copy link

Thanks for your great work!

But I have a problem about the model setting with your provided checkpoint.
I load your checkpoints, but the model setting that can be loaded correctly does not match what is written in the paper.

  1. the mlp_ratio of Large and Huge
  2. the patch_size of huge

I want to find out what's going on, thanks a lot!

image image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant