Skip to content

Commit 68aab43

Browse files
okdshinhmellor
andcommitted
Update docs/features/tool_calling.md
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by: okada shintarou <okada@preferred.jp>
1 parent 8db565c commit 68aab43

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

docs/features/tool_calling.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -103,7 +103,8 @@ When tool_choice='required' is set, the model is guaranteed to generate one or m
103103

104104
vLLM supports the `tool_choice='none'` option in the chat completion API. When this option is set, the model will not generate any tool calls and will respond with regular text content only, even if tools are defined in the request.
105105

106-
Note: When tools are specified in the request, vLLM includes tool definitions in the prompt by default, regardless of the `tool_choice` setting. To exclude tool definitions when `tool_choice='none'`, use the `--exclude-tools-when-tool-choice-none` option.
106+
!!! note
107+
When tools are specified in the request, vLLM includes tool definitions in the prompt by default, regardless of the `tool_choice` setting. To exclude tool definitions when `tool_choice='none'`, use the `--exclude-tools-when-tool-choice-none` option.
107108

108109
## Automatic Function Calling
109110

0 commit comments

Comments
 (0)