Skip to content

Conversation

matanyall
Copy link
Contributor

@matanyall matanyall commented May 21, 2025

Ollama updated their release process starting with 0.4.0, So I updated it to include 0.7.0 and all of the 0.6 releases.

@matanyall matanyall changed the title fix: upgrade ollama release format fix: upgrade ollama release source format May 21, 2025
Copy link
Collaborator

@alecthomas alecthomas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, thank you!

@alecthomas
Copy link
Collaborator

Wow I just noticed the Linux tarballs are 1.6GB:

image

Looks like they include a whole bunch of shared libs, which might be why CI is failing (ld library paths not set up correctly):

🐚 ~/dev/hermit-packages $ tar tfzv ~/Downloads/ollama-linux-amd64.tgz                                                    matanyall-update-ollama
-rwxr-xr-x  0 root   root 32402048 22 May 05:30 bin/ollama
drwxr-xr-x  0 root   root        0 22 May 05:40 lib/ollama/cuda_v11/
lrwxrwxrwx  0 root   root        0 22 May 05:40 lib/ollama/cuda_v11/libcublasLt.so.11 -> libcublasLt.so.11.5.1.109
-rwxr-xr-x  0 root   root 121866104  5 May  2021 lib/ollama/cuda_v11/libcublas.so.11.5.1.109
lrwxrwxrwx  0 root   root         0 22 May 05:40 lib/ollama/cuda_v11/libcudart.so.11.0 -> libcudart.so.11.3.109
lrwxrwxrwx  0 root   root         0 22 May 05:40 lib/ollama/cuda_v11/libcublas.so.11 -> libcublas.so.11.5.1.109
-rwxr-xr-x  0 root   root 799883944 22 May 05:40 lib/ollama/cuda_v11/libggml-cuda.so
-rwxr-xr-x  0 root   root 263770264  5 May  2021 lib/ollama/cuda_v11/libcublasLt.so.11.5.1.109
-rwxr-xr-x  0 root   root    619192  4 May  2021 lib/ollama/cuda_v11/libcudart.so.11.3.109
drwxr-xr-x  0 root   root         0 22 May 05:42 lib/ollama/cuda_v12/
-rwxr-xr-x  0 root   root 116388640  8 Jul  2015 lib/ollama/cuda_v12/libcublas.so.12.8.4.1
lrwxrwxrwx  0 root   root         0 22 May 05:42 lib/ollama/cuda_v12/libcublas.so.12 -> libcublas.so.12.8.4.1
lrwxrwxrwx  0 root   root         0 22 May 05:42 lib/ollama/cuda_v12/libcudart.so.12 -> libcudart.so.12.8.90
-rwxr-xr-x  0 root   root    728800  8 Jul  2015 lib/ollama/cuda_v12/libcudart.so.12.8.90
lrwxrwxrwx  0 root   root         0 22 May 05:42 lib/ollama/cuda_v12/libcublasLt.so.12 -> libcublasLt.so.12.8.4.1
-rwxr-xr-x  0 root   root 1285773272 22 May 05:42 lib/ollama/cuda_v12/libggml-cuda.so
-rwxr-xr-x  0 root   root  751771728  8 Jul  2015 lib/ollama/cuda_v12/libcublasLt.so.12.8.4.1
-rwxr-xr-x  0 root   root     595616 22 May 05:29 lib/ollama/libggml-base.so
-rwxr-xr-x  0 root   root     619280 22 May 05:29 lib/ollama/libggml-cpu-alderlake.so
-rwxr-xr-x  0 root   root     619280 22 May 05:29 lib/ollama/libggml-cpu-haswell.so
-rwxr-xr-x  0 root   root     725776 22 May 05:29 lib/ollama/libggml-cpu-icelake.so
-rwxr-xr-x  0 root   root     606992 22 May 05:29 lib/ollama/libggml-cpu-sandybridge.so
-rwxr-xr-x  0 root   root     729872 22 May 05:29 lib/ollama/libggml-cpu-skylakex.so
-rwxr-xr-x  0 root   root     480048 22 May 05:29 lib/ollama/libggml-cpu-sse42.so
-rwxr-xr-x  0 root   root     475952 22 May 05:29 lib/ollama/libggml-cpu-x64.so

@matanyall
Copy link
Contributor Author

Ah, that's unfortunate. Is there a fix? I want to use ollama in ci for sanity testing against a local llm.

@taniashiba
Copy link

Review please 🥺

@matanyall
Copy link
Contributor Author

if it's broke, it's broke, not ideal but it is what it is

fresh-prince-reaction-gif-by-moodman

@alecthomas alecthomas merged commit 69553e1 into cashapp:master May 23, 2025
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants