Search results

kv cache: integrate nixl for kv cache transfer

Status: Open.

#457 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kv cache: cache aware router

Status: Open.

#456 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kv cache: fp8/int8 kv cache support

Status: Open.

#455 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

model: add qwen new models

Status: Open.

#454 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

model: add deepseek new models

Status: Open.

#453 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kernel: tile scheduling

Status: Open.

#452 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kernel: attention kernel for sm_75/70

Status: Open.

#451 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

feat: disaggregate Prefill and Decoding

Status: Open.

#450 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kernel: deepep integration

Status: Open.

#449 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kernel: grouped gemm for MOE quantization

Status: Open.

#448 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kernel: attention kernel for sm_120

Status: Open.

#447 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025

kernel: attention kernel for sm_100/101

Status: Open.

#446 In vectorch-ai/ScaleLLM;

· guocuimi opened on May 1, 2025