You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Completes chat completion inference endpoint docs.
* Fixes format.
(cherry picked from commit 34d1af8)
Co-authored-by: István Zoltán Szabó <szabosteve@gmail.com>
Copy file name to clipboardExpand all lines: specification/inference/_types/CommonTypes.ts
+74-3Lines changed: 74 additions & 3 deletions
Original file line number
Diff line number
Diff line change
@@ -47,10 +47,47 @@ export class RequestChatCompletion {
47
47
temperature?: float
48
48
/**
49
49
* Controls which tool is called by the model.
50
+
* String representation: One of `auto`, `none`, or `requrired`. `auto` allows the model to choose between calling tools and generating a message. `none` causes the model to not call any tools. `required` forces the model to call one or more tools.
51
+
* Example (object representation):
52
+
* ```
53
+
* {
54
+
* "tool_choice": {
55
+
* "type": "function",
56
+
* "function": {
57
+
* "name": "get_current_weather"
58
+
* }
59
+
* }
60
+
* }
61
+
* ```
50
62
*/
51
63
tool_choice?: CompletionToolType
52
64
/**
53
65
* A list of tools that the model can call.
66
+
* Example:
67
+
* ```
68
+
* {
69
+
* "tools": [
70
+
* {
71
+
* "type": "function",
72
+
* "function": {
73
+
* "name": "get_price_of_item",
74
+
* "description": "Get the current price of an item",
Copy file name to clipboardExpand all lines: specification/inference/put_amazonbedrock/PutAmazonBedrockRequest.ts
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -30,7 +30,7 @@ import { InferenceChunkingSettings } from '@inference/_types/Services'
30
30
/**
31
31
* Create an Amazon Bedrock inference endpoint.
32
32
*
33
-
* Creates an inference endpoint to perform an inference task with the `amazonbedrock` service.
33
+
* Create an inference endpoint to perform an inference task with the `amazonbedrock` service.
34
34
*
35
35
* >info
36
36
* > You need to provide the access and secret keys only once, during the inference model creation. The get inference API does not retrieve your access or secret keys. After creating the inference model, you cannot change the associated key pairs. If you want to use a different access and secret key pair, delete the inference model and recreate it with the same name and the updated keys.
0 commit comments