Skip to content

Commit 98bf9d6

Browse files
Update docs/genai/howto/past-present-share-buffer.md
1 parent 68e3b2c commit 98bf9d6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/genai/howto/past-present-share-buffer.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ The past present share buffer is an optimization that can be used to save memory
1313

1414
When the share buffer is used, the past and present KV cache buffers point to the same memory block.
1515

16-
When the share buffer is not used, the present KV cache buffers are re-allocated before every forward pass of the model, and copied to the past KV cache buffers.
16+
When buffer sharing is not used, the present KV cache buffers are re-allocated before every forward pass of the model and copied to the past KV cache buffers.
1717

1818
This is represented in the following diagram
1919

0 commit comments

Comments
 (0)