Skip to content

DeepSeek: a short prompt's least-picked RAM experts on the CPU lane while the GPU streams the rest (MAYA_DS4_PREFILL_CPU, opt-in) - an agent's turn ~40% faster on PCIe 3.0 - #959

Open
PrimusInterParis wants to merge 3 commits into
mw00:mainfrom
PrimusInterParis:ds4-prefill-cpu
Open

DeepSeek: a short prompt's least-picked RAM experts on the CPU lane while the GPU streams the rest (MAYA_DS4_PREFILL_CPU, opt-in) - an agent's turn ~40% faster on PCIe 3.0#959
PrimusInterParis wants to merge 3 commits into
mw00:mainfrom
PrimusInterParis:ds4-prefill-cpu

DeepSeek prompt CPU share: the CPU lane's row time measured at the lo…

20e2451
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs