单卡3090成功运行 Yi-34B-Chat-AWQ 34B参数模型 #2582
Closed
knifecaojia
started this conversation in
Show and tell
Replies: 2 comments
-
|
能问一下你的python、cuda的版本吗？我这边部署会报很多错。 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
可以的，就是载入方式要自己整 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
无聊逛知乎发现这篇文章
https://zhuanlan.zhihu.com/p/669147983
我想试试在3090单卡环境是否能够运行
Beta Was this translation helpful? Give feedback.
All reactions