File tree Expand file tree Collapse file tree 2 files changed +14
-11
lines changed Expand file tree Collapse file tree 2 files changed +14
-11
lines changed Original file line number Diff line number Diff line change @@ -36,28 +36,25 @@ Copy and paste the content of `cf-worker.js` into your cloudflare worker and dep
36
36
37
37
## Docker
38
38
39
- build the image
40
- ~~~ sh
41
- docker build -t sambanova .
42
- ~~~
39
+ The docker image for this project is hosted on GitHub Container Registry and automatically build via GitHub action.
43
40
44
41
docker run
45
42
~~~ sh
46
- docker run \
43
+ docker run -d \
47
44
--name sambanova-ai-proxy \
48
45
-p 11435:11435 \
49
46
--read-only \
50
- sambanova
47
+ ghcr.io/lingo34/ sambanova-ai-proxy:main
51
48
~~~
52
49
53
- if you want to enable model override and specified a model, you can pass it as an environment variable
50
+ if you want to enable model override and specified a model, you can pass it as an environment variable.
54
51
~~~ sh
55
- docker run \
52
+ docker run -d \
56
53
--name sambanova-ai-proxy \
57
54
-p 11435:11435 \
58
55
--read-only \
59
56
-e MODEL_OVERRIDE=" llama3-405b" \
60
- sambanova
57
+ ghcr.io/lingo34/ sambanova-ai-proxy:main
61
58
~~~
62
59
63
60
or you can you docker compose: in the project directory, execute:
@@ -71,7 +68,7 @@ version: '3.8'
71
68
72
69
services :
73
70
node-server :
74
- image : sambanova
71
+ image : ghcr.io/lingo34/ sambanova-ai-proxy:main
75
72
container_name : sambanova-ai-proxy
76
73
ports :
77
74
- " 11435:11435"
@@ -80,3 +77,9 @@ services:
80
77
read_only : true
81
78
restart : unless-stopped
82
79
~~~
80
+
81
+ or if you want to build the image yourself
82
+
83
+ ~~~sh
84
+ docker build -t sambanova-ai-proxy .
85
+ ~~~
Original file line number Diff line number Diff line change @@ -2,7 +2,7 @@ version: '3.8'
2
2
3
3
services :
4
4
node-server :
5
- image : sambanova
5
+ image : ghcr.io/lingo34/ sambanova-ai-proxy:main
6
6
container_name : sambanova-ai-proxy
7
7
ports :
8
8
- " 11435:11435"
You can’t perform that action at this time.
0 commit comments