[RFC]: fp8 KV cache for the Ampere sparse-MLA path (TRITON_MLA_SPARSE) via software dequant #14109
Annotations
10 notices
|
add-labels
Processing label: cpu
|
|
add-labels
No matching terms found for label "rocm".
|
|
add-labels
Reason: No matching terms found
|
|
add-labels
Final decision: DO NOT ADD LABEL
|
|
add-labels
Searching in body (5874 characters)
|
|
add-labels
Searching in title: "[RFC]: fp8 KV cache for the Ampere sparse-MLA path (TRITON_MLA_SPARSE) via software dequant"
|
|
add-labels
Searching with 5 keywords, 12 substrings, and 1 regex patterns
|
|
add-labels
Issue Body length: 5874 characters
|
|
add-labels
Issue Title: "[RFC]: fp8 KV cache for the Ampere sparse-MLA path (TRITON_MLA_SPARSE) via software dequant"
|
|
add-labels
Processing label: rocm
|