Skip to content

Commit b2e65cb

Browse files
authored
[benchmark] Make request IDs unique across clients by default (#27723)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
1 parent 2bf0bcc commit b2e65cb

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/benchmarks/serve.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@
2626
import random
2727
import shutil
2828
import time
29+
import uuid
2930
import warnings
3031
from collections.abc import AsyncGenerator, Iterable
3132
from dataclasses import dataclass
@@ -1160,7 +1161,7 @@ def add_cli_args(parser: argparse.ArgumentParser):
11601161
"--request-id-prefix",
11611162
type=str,
11621163
required=False,
1163-
default="benchmark-serving",
1164+
default=f"bench-{uuid.uuid4().hex[:8]}-",
11641165
help="Specify the prefix of request id.",
11651166
)
11661167

0 commit comments

Comments
 (0)