How to only download model without serving it? #11524
yardenshoham
announced in
Q&A
Replies: 1 comment
-
|
I think you can use |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently I run
vllm serveand look at~/.cache/huggingfaceto get the model. I cancelvllm serveonce it started. Is there somevllm pullcommand?Beta Was this translation helpful? Give feedback.
All reactions