Skip to content

Commit b966e87

Browse files
authored
updates in documentation (#3223)
1 parent 8216091 commit b966e87

File tree

2 files changed

+3
-1
lines changed

2 files changed

+3
-1
lines changed

demos/continuous_batching/accuracy/README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,7 @@ export OPENAI_COMPATIBLE_API_URL=http://localhost:8000/v3
8080
export OPENAI_COMPATIBLE_API_KEY="unused"
8181
git clone https://github.com/EvolvingLMMs-Lab/lmms-eval
8282
cd lmms-eval
83+
git checkout 4471ad311e620ed6cf3a0419d8ba6f18f8fb1cb3 # https://github.com/EvolvingLMMs-Lab/lmms-eval/issues/625
8384
pip install -e . --extra-index-url "https://download.pytorch.org/whl/cpu"
8485
python -m lmms_eval \
8586
--model openai_compatible \
@@ -101,7 +102,7 @@ openai_compatible (model_version=OpenGVLab/InternVL2_5-8B,max_retries=1), gen_kw
101102
|--------|-------|------|-----:|--------------------|---|--------:|---|------|
102103
|mme |Yaml |none | 0|mme_cognition_score |↑ | 600.3571|± | N/A|
103104
|mme |Yaml |none | 0|mme_perception_score|↑ |1618.2984|± | N/A|
104-
|mmmu_val| 0|none | 0|mmmu_acc |↑ | 0.5100|± | N/A|
105+
|mmmu_val| 0|none | 0|mmmu_acc |↑ | 0.5322|± | N/A|
105106
106107
```
107108

demos/continuous_batching/vlm/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -46,6 +46,7 @@ python export_model.py text_generation --source_model OpenGVLab/InternVL2_5-8B -
4646
> **Note:** Change the `--weight-format` to quantize the model to `int8` or `int4` precision to reduce memory consumption and improve performance.
4747
4848
> **Note:** You can change the model used in the demo out of any topology [tested](https://github.com/openvinotoolkit/openvino.genai/blob/master/SUPPORTED_MODELS.md#visual-language-models) with OpenVINO.
49+
Be aware that QwenVL models executed on GPU might experience execution errors with very high resolution images. In case of such behavior, it is recommended to reduce the parameter `max_pixels` in `preprocessor_config.json`.
4950

5051
You should have a model folder like below:
5152
```

0 commit comments

Comments
 (0)