Skip to content

Commit c38a798

Browse files
kthuirmccorm4
andauthored
[docs] Minor wording updates
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
1 parent 17ae25c commit c38a798

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/additional_outputs.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -57,15 +57,15 @@ point value will be sent on the `cumulative_logprob` output tensor.
5757

5858
### Log Probabilities
5959

60-
The log probabilities of the top probability words at each position if the
60+
The log probabilities of the top probability tokens at each position of the
6161
[logprobs](https://github.com/vllm-project/vllm/blob/v0.6.3.post1/vllm/sampling_params.py#L146-L152)
6262
are requested. Only the log probabilities of the new tokens generated since the
6363
last response are returned on each new response. See
6464
[here](https://github.com/vllm-project/vllm/blob/v0.6.3.post1/vllm/outputs.py#L24-L25)
6565
for more details on the log probabilities.
6666

6767
To enable, set `return_logprobs` input tensor to `True`. The log probabilities
68-
will be sent on the `logprobs` output tensor as JSON.
68+
will be sent on the `logprobs` output tensor as a serialized JSON string.
6969

7070
### Number of Input Tokens
7171

0 commit comments

Comments
 (0)