We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent c63b4f8 commit 3206acaCopy full SHA for 3206aca
examples/others/lmcache/disagg_prefill_lmcache_v1/disagg_vllm_launcher.sh
@@ -15,6 +15,14 @@ else
15
MODEL=$2
16
fi
17
18
+# The prefillers and decoders in LMCache use the same hash seed for all chunk keys.
19
+# This seed must be aligned so that decoders can identify and retrieve KV cache
20
+# entries stored by prefillers.
21
+#
22
+# WARNING: Using a fixed hash seed is insecure and makes the application vulnerable to
23
+# denial-of-service attacks. In a production environment, this should be set to a
24
+# secure random value. This is set to a fixed value for demonstration purposes only.
25
+export PYTHONHASHSEED=${VLLM_PYTHON_HASH_SEED:-123}
26
27
if [[ $1 == "prefiller" ]]; then
28
# Prefiller listens on port 8100
0 commit comments