Skip to content

Commit 25c7f1e

Browse files
dm4hydai
authored andcommitted
ci: remove llava related jobs
Signed-off-by: dm4 <dm4@secondstate.io>
1 parent 54dc9d4 commit 25c7f1e

File tree

1 file changed

+0
-38
lines changed

1 file changed

+0
-38
lines changed

.github/workflows/llama.yml

Lines changed: 0 additions & 38 deletions
Original file line numberDiff line numberDiff line change
@@ -57,25 +57,6 @@ jobs:
5757
default \
5858
'<start_of_turn>user Where is the capital of Japan? <end_of_turn><start_of_turn>model'
5959
60-
- name: Llava v1.6 7B
61-
shell: bash
62-
run: |
63-
test -f ~/.wasmedge/env && source ~/.wasmedge/env
64-
cd wasmedge-ggml/llava
65-
curl -LO https://huggingface.co/cmp-nct/llava-1.6-gguf/resolve/main/vicuna-7b-q5_k.gguf
66-
curl -LO https://huggingface.co/cmp-nct/llava-1.6-gguf/resolve/main/mmproj-vicuna7b-f16.gguf
67-
curl -LO https://llava-vl.github.io/static/images/monalisa.jpg
68-
cargo build --target wasm32-wasip1 --release
69-
time wasmedge --dir .:. \
70-
--env mmproj=mmproj-vicuna7b-f16.gguf \
71-
--env image=monalisa.jpg \
72-
--env ctx_size=4096 \
73-
--env n_gpu_layers="$NGL" \
74-
--nn-preload default:GGML:AUTO:vicuna-7b-q5_k.gguf \
75-
target/wasm32-wasip1/release/wasmedge-ggml-llava.wasm \
76-
default \
77-
$'You are a helpful, respectful and honest assistant. Always answer as short as possible, while being safe.\nUSER:<image>\nDo you know who drew this painting?\nASSISTANT:'
78-
7960
- name: Llama3 8B
8061
shell: bash
8162
run: |
@@ -106,25 +87,6 @@ jobs:
10687
default \
10788
$"<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nYou are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you do not know the answer to a question, please do not share false information.<|eot_id|>\n<|start_header_id|>user<|end_header_id|>\n\nWhat's the capital of Japan?<|eot_id|>\n<|start_header_id|>assistant<|end_header_id|>\n\n"
10889
109-
- name: Multiple Models Example
110-
shell: bash
111-
run: |
112-
test -f ~/.wasmedge/env && source ~/.wasmedge/env
113-
cd wasmedge-ggml/multimodel
114-
curl -LO https://huggingface.co/second-state/Llama-2-7B-Chat-GGUF/resolve/main/llama-2-7b-chat.Q5_K_M.gguf
115-
curl -LO https://huggingface.co/cmp-nct/llava-1.6-gguf/resolve/main/vicuna-7b-q5_k.gguf
116-
curl -LO https://huggingface.co/cmp-nct/llava-1.6-gguf/resolve/main/mmproj-vicuna7b-f16.gguf
117-
curl -LO https://llava-vl.github.io/static/images/monalisa.jpg
118-
cargo build --target wasm32-wasip1 --release
119-
time wasmedge --dir .:. \
120-
--env n_gpu_layers="$NGL" \
121-
--env image=monalisa.jpg \
122-
--env mmproj=mmproj-vicuna7b-f16.gguf \
123-
--nn-preload llama2:GGML:AUTO:llama-2-7b-chat.Q5_K_M.gguf \
124-
--nn-preload llava:GGML:AUTO:vicuna-7b-q5_k.gguf \
125-
target/wasm32-wasip1/release/wasmedge-ggml-multimodel.wasm \
126-
'describe this picture please'
127-
12890
- name: Embedding Example (All-MiniLM)
12991
shell: bash
13092
run: |

0 commit comments

Comments
 (0)