Skip to content

Commit 201330e

Browse files
s-noghabiThe tunix Authors
authored andcommitted
ensure seed is set for VLLM sampling params
PiperOrigin-RevId: 875753179
1 parent 791d90c commit 201330e

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

tunix/generate/vllm_sampler.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -415,6 +415,9 @@ def __call__(
415415
if top_k is not None:
416416
sampling_params.top_k = top_k
417417

418+
if seed is not None:
419+
sampling_params.seed = seed
420+
418421
if kwargs:
419422
try:
420423
sampling_params.update(**kwargs)

0 commit comments

Comments
 (0)