Skip to content

Commit 1de7c1a

Browse files
committed
Enable v2 by default
Signed-off-by: yizhang-nv <187001205+yizhang-nv@users.noreply.github.com>
1 parent 72184bf commit 1de7c1a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/llmapi/llm_args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1763,7 +1763,7 @@ class KvCacheConfig(StrictBaseModel, PybindMirror):
17631763
description="The number of tokens per block.")
17641764

17651765
use_kv_cache_manager_v2: bool = Field(
1766-
default=False,
1766+
default=True,
17671767
status="prototype",
17681768
description="Whether to use the KV cache manager v2 (experimental).")
17691769

0 commit comments

Comments
 (0)