[RFC]: Context-length-aware speculative token scheduling — extending num_speculative_tokens_per_batch_size with a context-length axis #14235
Annotations
10 notices
|
add-labels
Processing label: cpu
|
|
add-labels
No matching terms found for label "rocm".
|
|
add-labels
Reason: No matching terms found
|
|
add-labels
Final decision: DO NOT ADD LABEL
|
|
add-labels
Searching in body (10237 characters)
|
|
add-labels
Searching in title: "[RFC]: Context-length-aware speculative token scheduling — extending num_speculative_tokens_per_batch_size with a context-length axis"
|
|
add-labels
Searching with 5 keywords, 12 substrings, and 1 regex patterns
|
|
add-labels
Issue Body length: 10237 characters
|
|
add-labels
Issue Title: "[RFC]: Context-length-aware speculative token scheduling — extending num_speculative_tokens_per_batch_size with a context-length axis"
|
|
add-labels
Processing label: rocm
|