Skip to content

Commit 40a4662

Browse files
authored
minor fix for quick start llm demo (#3266)
1 parent 21728e3 commit 40a4662

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

docs/llm/quickstart.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@ python export_model.py text_generation --source_model OpenVINO/Phi-3.5-mini-inst
2626
LLM engine parameters will be defined inside the `graph.pbtxt` file.
2727

2828
> **Note:** The users in China need to set environment variable `HF_ENDPOINT="https://hf-mirror.com"` before running the export script to connect to the HF Hub.
29+
2930
> **Note:** If you want to export models outside of the `OpenVINO` organization in HuggingFace, you need to install additional Python dependencies:
3031
> ```console
3132
> pip3 install -r https://raw.githubusercontent.com/openvinotoolkit/model_server/refs/heads/releases/2025/1/demos/common/export_models/requirements.txt
@@ -46,7 +47,7 @@ docker run -d --device /dev/dri --group-add=$(stat -c "%g" /dev/dri/render*) --r
4647
**Required:** OpenVINO Model Server package - see [deployment instructions](../deploying_server_baremetal.md) for details.
4748

4849
```bat
49-
ovms --rest_port 8000 --model_name Phi-3.5-mini-instruct --model_path /models/OpenVINO/Phi-3.5-mini-instruct-int4-ov
50+
ovms --rest_port 8000 --model_name Phi-3.5-mini-instruct --model_path models/OpenVINO/Phi-3.5-mini-instruct-int4-ov
5051
```
5152
:::
5253
::::
@@ -102,6 +103,7 @@ curl -s http://localhost:8000/v3/chat/completions \
102103
:::{tab-item} Windows
103104

104105
Windows Powershell
106+
```bat
105107
(Invoke-WebRequest -Uri "http://localhost:8000/v3/chat/completions" `
106108
-Method POST `
107109
-Headers @{ "Content-Type" = "application/json" } `

0 commit comments

Comments
 (0)