Skip to content

Commit a326eb6

Browse files
committed
fix(sglang): regression on logprob computation
1 parent 59ee80b commit a326eb6

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/strands_sglang/sglang.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -354,6 +354,7 @@ async def stream(
354354
input_ids=input_ids,
355355
sampling_params=sampling_params,
356356
return_logprob=return_logprob,
357+
logprob_start_len=0 if return_logprob else None,
357358
)
358359

359360
# Extract response data

0 commit comments

Comments
 (0)