Add Multi-Token Prediction (MTP) support for speculative decoding#1122
Open
dcol91863 wants to merge 2 commits into
Open
Add Multi-Token Prediction (MTP) support for speculative decoding#1122dcol91863 wants to merge 2 commits into
dcol91863 wants to merge 2 commits into