Skip to content

MLA的KV_cache问题 #21

New issue
New issue
Open
Open
MLA的KV_cache问题#21
@Messiahccgr

Description

@Messiahccgr
Messiahccgr
opened on Apr 27, 2025

这里的kvcache的实现，是不是每一次都会覆盖式更新，而非增量追加呀，个人感觉是不是需要额外维护一个step变量来记录当前填充位置

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions