File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -57,15 +57,15 @@ point value will be sent on the `cumulative_logprob` output tensor.
5757
5858### Log Probabilities
5959
60- The log probabilities of the top probability words at each position if the
60+ The log probabilities of the top probability tokens at each position of the
6161[ logprobs] ( https://github.com/vllm-project/vllm/blob/v0.6.3.post1/vllm/sampling_params.py#L146-L152 )
6262are requested. Only the log probabilities of the new tokens generated since the
6363last response are returned on each new response. See
6464[ here] ( https://github.com/vllm-project/vllm/blob/v0.6.3.post1/vllm/outputs.py#L24-L25 )
6565for more details on the log probabilities.
6666
6767To enable, set ` return_logprobs ` input tensor to ` True ` . The log probabilities
68- will be sent on the ` logprobs ` output tensor as JSON.
68+ will be sent on the ` logprobs ` output tensor as a serialized JSON string .
6969
7070### Number of Input Tokens
7171
You can’t perform that action at this time.
0 commit comments