[Bug] 'DeepSeekV4SingleKVPoolHost' object has no attribute 'get_contiguous_buf_infos'

[xhchen28]

Checklist

• I searched related issues but found no solution.
• The bug persists in the latest version.
• Issues without environment info and a minimal reproducible demo are hard to resolve and may receive no feedback.
• If this is not a bug report but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
• Please use English. Otherwise, it will be closed.

Describe the bug

I encountered this bug when launching the SGLang server with the --enable-hisparse flag using the command below. The version of sglang is v0.5.12.

Reproduction

To reproduce the bug, please run the shell command below.

export SGLANG_ENABLE_SPEC_V2=0
export MC_TE_METRIC=true
export MC_IB_PCI_RELAXED_ORDERING=1
export MC_NUM_QP_PER_EP=16
export MC_HANDSHAKE_MAX_LENGTH=10485760
export SGLANG_TBO_DEBUG=0
export SGLANG_DISAGGREGATION_THREAD_POOL_SIZE=50
export SGLANG_DISAGGREGATION_QUEUE_SIZE=50
export SGLANG_TOOL_STRICT_LEVEL="1"
export SGLANG_MOONCAKE_SEND_AUX_TCP=1
export SGLANG_LOG_MS=1
export SGLANG_JIT_DEEPGEMM_PRECOMPILE=0
export SGLANG_ENABLE_OPT_PREBUILT_BATCH=1
export NVSHMEM_DISABLE_NCCL=1
export CUDA_VISIBLE_DEVICES="0,1,2,3,4,5,6,7"
export DP_SIZE=8
export TP_SIZE=8
export SGLANG_DSV4_MTP_OPT_LOAD=1
export SGLANG_OPT_USE_DEEPGEMM_MEGA_MOE=1
export SGLANG_OPT_MEGA_MOE_FUSED_PRE_DISPATCH=1
export SGLANG_OPT_FIX_MEGA_MOE_MEMORY=1
export SGLANG_OPT_SWIGLU_CLAMP_FUSION=1
export SGLANG_OPT_USE_JIT_EP_ACTIVATION=1
export SGLANG_OPT_FIX_HASH_MEGA_MOE=1
export SGLANG_OPT_DEEPGEMM_MEGA_MOE_NUM_MAX_TOKENS_PER_RANK=352
export SGLANG_OPT_FIX_NEXTN_MEGA_MOE=1
export SGLANG_DEEPEP_NUM_MAX_DISPATCH_TOKENS_PER_RANK=0
export SGLANG_OPT_MEGA_MOE_KEEP_NEW_SF_ONLY=1

python3 -m sglang.launch_server \
    --trust-remote-code \
    --model-path $MODEL_PATH \
    --served-model-name $MODEL_ID \
    --tp $TP_SIZE \
    --dp $DP_SIZE \
    --disable-radix-cache \
    --disable-overlap-schedule \
    --deepep-mode low_latency \
    --enable-dp-attention \
    --trust-remote-code \
    --decode-log-interval 8 \
    --moe-a2a-backend deepep   \
    --disaggregation-bootstrap-port 8200 \
    --disaggregation-ib-device mlx5_bond_0 \
    --disaggregation-mode decode \
    --disaggregation-transfer-backend mooncake \
    --allow-auto-truncate \
    --collect-tokens-histogram \
    --enable-metrics \
    --mem-fraction-static 0.9 \
    --swa-full-tokens-ratio 0.03 \
    --dist-init-addr 127.0.0.1:6676 \
    --max-running-requests $((72 * DP_SIZE)) \
    --cuda-graph-max-bs 72 \
    --cuda-graph-bs 1 2 4 8 16 24 32 40 48 64 72 \
    --disable-cuda-graph \
    --host 0.0.0.0 \
    --model-loader-extra-config '{"enable_multithread_load": true, "num_threads": 8}' \
    --tokenizer-worker-num 32 \
    --tool-call-parser deepseekv4 \
    --enable-dp-lm-head \
    --port 8000 \
    --enable-hisparse

Environment

root@tjzj-inf-sci-k8s-bzz2-0200:/workspace# Python: 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0]
CUDA available: True
GPU 0,1,2,3,4,5,6,7: CF-NG-BZZ2-O
GPU 0,1,2,3,4,5,6,7 Compute Capability: 10.0
CUDA_HOME: /usr/local/cuda
NVCC: Cuda compilation tools, release 13.0, V13.0.88
CUDA Driver Version: 580.95.05
PyTorch: 2.11.0+cu130
sglang: 0.5.12
sglang-kernel: 0.4.2.post2
flashinfer_python: 0.6.11.post1
flashinfer_cubin: 0.6.11.post1
flashinfer_jit_cache: 0.6.11.post1+cu130
triton: 3.6.0
transformers: 5.6.0
torchao: 0.17.0+cu130
numpy: 1.26.4
aiohttp: 3.13.5
fastapi: 0.136.1
huggingface_hub: 1.15.0
interegular: 0.3.3
modelscope: 1.37.0
orjson: 3.11.9
outlines: 0.1.11
packaging: 26.2
psutil: 7.2.2
pydantic: 2.13.4
python-multipart: 0.0.28
pyzmq: 27.1.0
uvicorn: 0.47.0
uvloop: 0.22.1
vllm: Module Not Found
xgrammar: 0.2.0
openai: 2.6.1
tiktoken: 0.13.0
anthropic: 0.102.0
litellm: Module Not Found
torchcodec: 0.11.1+cu130
NVIDIA Topology:
GPU0 GPU1 GPU2 GPU3 GPU4 GPU5 GPU6 GPU7 NIC0 NIC1 NIC2 NIC3 NIC4 NIC5 NIC6 NIC7 NIC8 CPU Affinity NUMA Affinity GPU NUMA ID
GPU0 X NV18 NV18 NV18 NV18 NV18 NV18 NV18 PIX NODE NODE NODE SYS SYS SYS SYS NODE 0-47,96-143 0 N/A
GPU1 NV18 X NV18 NV18 NV18 NV18 NV18 NV18 NODE PIX NODE NODE SYS SYS SYS SYS NODE 0-47,96-143 0 N/A
GPU2 NV18 NV18 X NV18 NV18 NV18 NV18 NV18 NODE NODE PIX NODE SYS SYS SYS SYS NODE 0-47,96-143 0 N/A
GPU3 NV18 NV18 NV18 X NV18 NV18 NV18 NV18 NODE NODE NODE PIX SYS SYS SYS SYS NODE 0-47,96-143 0 N/A
GPU4 NV18 NV18 NV18 NV18 X NV18 NV18 NV18 SYS SYS SYS SYS PIX NODE NODE NODE SYS 48-95,144-191 1 N/A
GPU5 NV18 NV18 NV18 NV18 NV18 X NV18 NV18 SYS SYS SYS SYS NODE PIX NODE NODE SYS 48-95,144-191 1 N/A
GPU6 NV18 NV18 NV18 NV18 NV18 NV18 X NV18 SYS SYS SYS SYS NODE NODE PIX NODE SYS 48-95,144-191 1 N/A
GPU7 NV18 NV18 NV18 NV18 NV18 NV18 NV18 X SYS SYS SYS SYS NODE NODE NODE PIX SYS 48-95,144-191 1 N/A
NIC0 PIX NODE NODE NODE SYS SYS SYS SYS X NODE NODE NODE SYS SYS SYS SYS NODE
NIC1 NODE PIX NODE NODE SYS SYS SYS SYS NODE X NODE NODE SYS SYS SYS SYS NODE
NIC2 NODE NODE PIX NODE SYS SYS SYS SYS NODE NODE X NODE SYS SYS SYS SYS NODE
NIC3 NODE NODE NODE PIX SYS SYS SYS SYS NODE NODE NODE X SYS SYS SYS SYS NODE
NIC4 SYS SYS SYS SYS PIX NODE NODE NODE SYS SYS SYS SYS X NODE NODE NODE SYS
NIC5 SYS SYS SYS SYS NODE PIX NODE NODE SYS SYS SYS SYS NODE X NODE NODE SYS
NIC6 SYS SYS SYS SYS NODE NODE PIX NODE SYS SYS SYS SYS NODE NODE X NODE SYS
NIC7 SYS SYS SYS SYS NODE NODE NODE PIX SYS SYS SYS SYS NODE NODE NODE X SYS
NIC8 NODE NODE NODE NODE SYS SYS SYS SYS NODE NODE NODE NODE SYS SYS SYS SYS X

Legend:

X = Self
SYS = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
PHB = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
PXB = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
PIX = Connection traversing at most a single PCIe bridge
NV# = Connection traversing a bonded set of # NVLinks

NIC Legend:

NIC0: mlx5_4
NIC1: mlx5_7
NIC2: mlx5_8
NIC3: mlx5_9
NIC4: mlx5_10
NIC5: mlx5_11
NIC6: mlx5_12
NIC7: mlx5_13
NIC8: mlx5_bond_0

ulimit soft: 1048576