Skip to content

Commit 29adf39

Browse files
dm4hydai
authored andcommitted
ci(unload): use gemma-2b model for the unload test
Signed-off-by: dm4 <dm4@secondstate.io>
1 parent 25c7f1e commit 29adf39

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

.github/workflows/llama.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -171,13 +171,13 @@ jobs:
171171
run: |
172172
test -f ~/.wasmedge/env && source ~/.wasmedge/env
173173
cd wasmedge-ggml/test/unload
174-
curl -LO https://huggingface.co/second-state/Llama-2-7B-Chat-GGUF/resolve/main/llama-2-7b-chat.Q5_K_M.gguf
174+
curl -LO https://huggingface.co/second-state/Gemma-2b-it-GGUF/resolve/main/gemma-2b-it-Q5_K_M.gguf
175175
cargo build --target wasm32-wasip1 --release
176176
time wasmedge --dir .:. \
177-
--nn-preload default:GGML:AUTO:llama-2-7b-chat.Q5_K_M.gguf \
177+
--nn-preload default:GGML:AUTO:gemma-2b-it-Q5_K_M.gguf \
178178
target/wasm32-wasip1/release/wasmedge-ggml-unload.wasm \
179179
default \
180-
$'[INST] <<SYS>>\nYou are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you do not know the answer to a question, please do not share false information.\n<</SYS>>\nWhat is the capital of Japan?[/INST]'
180+
'<start_of_turn>user Where is the capital of Japan? <end_of_turn><start_of_turn>model'
181181
182182
- name: JSON Schema
183183
shell: bash

0 commit comments

Comments
 (0)