Skip to content

Commit 4dbc483

Browse files
[BugFix]Fix sample rejection (#2908) (#2949)
* fix config * fix rejection Co-authored-by: YuanRisheng <yuanrisheng@baidu.com>
1 parent 4ead158 commit 4dbc483

File tree

2 files changed

+1
-2
lines changed

2 files changed

+1
-2
lines changed

fastdeploy/config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ def __init__(
8888
self.stop_seqs_max_len = 8
8989

9090
# NOTE(gongshaotain): form _load_model_init_val()
91-
self.top_p = 0.0
91+
self.top_p = 1.0
9292
self.temperature = 1.0
9393
self.rope_theta = 10000.0
9494
self.penalty_score = 1.0

fastdeploy/worker/gpu_model_runner.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -408,7 +408,6 @@ def _dummy_prefill_inputs(self, num_tokens: int, batch_size: int,
408408
self.share_inputs["max_dec_len"][idx:idx + 1] = max_dec_len
409409
self.share_inputs["min_dec_len"][idx:idx + 1] = max_dec_len
410410
self.share_inputs["stop_flags"][idx:idx + 1] = False
411-
self.share_inputs["top_p"][idx:idx + 1] = 0.0
412411
self.share_inputs["temperature"][idx:idx + 1] = 1
413412

414413
self.share_inputs["first_token_ids"][

0 commit comments

Comments
 (0)