How to access the 'default' sampling_params of the LLM? #5429
namespace-Pt
announced in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
From my understanding, each model has a default sampling_params specifying the
bos_token_idandeos_token_idjust likeGenerationConfigin huggingface. I cannot find an entry to a defaultsampling_paramsfrom theLLMclass. Can anyone help me? Thanks in advance.Beta Was this translation helpful? Give feedback.
All reactions