feat(Llama GQA): optional shared-KV matmul rewrite for attention. WIP: (env-gated)#905

vbaddi wants to merge 1 commit intoquic:mainquic/efficient-transformers:mainfrom

vbaddi:feat/enable_llama_gqa_shared_kvvbaddi/efficient-transformers:feat/enable_llama_gqa_shared_kvCopy head branch name to clipboard