[RFC]: Context-length-aware speculative token scheduling — extending num_speculative_tokens_per_batch_size with a context-length axis #14235
Annotations
10 notices
|
Label issues based on keywords
Processing label: cpu
|
|
Label issues based on keywords
No matching terms found for label "rocm".
|
|
Label issues based on keywords
Reason: No matching terms found
|
|
Label issues based on keywords
Final decision: DO NOT ADD LABEL
|
|
Label issues based on keywords
Searching in body (10237 characters)
|
|
Label issues based on keywords
Searching in title: "[RFC]: Context-length-aware speculative token scheduling — extending num_speculative_tokens_per_batch_size with a context-length axis"
|
|
Label issues based on keywords
Searching with 5 keywords, 12 substrings, and 1 regex patterns
|
|
Label issues based on keywords
Issue Body length: 10237 characters
|
|
Label issues based on keywords
Issue Title: "[RFC]: Context-length-aware speculative token scheduling — extending num_speculative_tokens_per_batch_size with a context-length axis"
|
|
Label issues based on keywords
Processing label: rocm
|
background
wait
wait-all
cancel
parallel
Loading