[https://nvbugs/5764627][fix] Fix generation logits with streaming and improve runtime of logits testcase. Also fixes https://nvbugs/5573238#10637

Merged

stnie merged 7 commits intoNVIDIA:mainfrom

stnie:bugfix/5764627

Mar 2, 2026

Commits on Feb 26, 2026

[https://nvbugs/5573238][fix] Fix error in generation logits handling in LlmRequest and adjust generation request state management in PyExecutor.
stnie
committed
[https://nvbugs/5764627][fix] Refactor return logits tests to reuse similar code and reduce runtime.
stnie
committed
Refactor deep copy logic for generation logits in LlmRequest.
stnie
committed
Refactor LlmRequest and PyExecutor for improved state management and deep copy logic.
stnie
committed
address review comments
stnie
committed
Adjust when set_exclude_last_generation_logits is called
stnie
committed
Introduce a function to update the state of generation requests, that will finish next iteration
stnie
committed