Code

Deepseek r1#3211

Code

Draft

sywangyi wants to merge 7 commits intohuggingface:mainhuggingface/text-generation-inference:mainfrom

sywangyi:deepseek_r1sywangyi/text-generation-inference:deepseek_r1Copy head branch name to clipboard

Commits

Commits on May 7, 2025

• enable deepseek_r1

  Show description for debf477
  sywangyi

  committed
  debf477

  Copy full SHA for debf477

• add ep

  Show description for 3db50ed
  sywangyi

  committed
  3db50ed

  Copy full SHA for 3db50ed

• lazy mode

  Show description for 2007269
  sywangyi

  committed
  2007269

  Copy full SHA for 2007269

• fp8 kv cache

  Show description for 1cda911
  sywangyi

  committed
  1cda911

  Copy full SHA for 1cda911

• refine free memory and bypass graph logic

  Show description for ff5bc1b
  sywangyi

  committed
  ff5bc1b

  Copy full SHA for ff5bc1b

• if limit is set, all prefill will bypass graph

  Show description for 316cb08
  sywangyi

  committed
  316cb08

  Copy full SHA for 316cb08

Commits on May 9, 2025

• update to latest vllm extension ops

  Show description for 249ccfc
  sywangyi

  committed
  249ccfc

  Copy full SHA for 249ccfc