feat(pytorch): add piecewise CUDA graph prefill - #4895

Open

grimoire wants to merge 24 commits into

InternLM:mainfrom

grimoire:feat/piecewise-cudagraph-runtime

Commits on Aug 21, 2026

Commits on Aug 22, 2026

Commits on Aug 23, 2026

feat(pytorch): add Qwen3.5 piecewise cudagraph prefill
grimoire
committed
f8b10f9
refactor(pytorch): bind PCG attention metadata explicitly
grimoire
committed
8581aaa

Commits on Aug 24, 2026

refactor(pytorch): reuse main forward stream for piecewise cudagraph

grimoire
and
claude
committed
19ccd08
feat(pytorch): add tqdm progress bars for warmup phases

grimoire
and
claude
committed
233cd60

Commits on Aug 25, 2026

test(pytorch): fix mla attention test for explicit kernel_metadata contract

grimoire
and
claude
committed
1c90e8f
refactor(pytorch): drop conservative PCG quant/chunk prefill guards

grimoire
and
claude
committed
1f6472a
refactor(pytorch): gate PCG prepare behind an explicit warmup scope

grimoire
and
claude
committed
9d5a8e6

Commits on Aug 27, 2026

Commits on Aug 28, 2026

support dp
grimoire
committed
5471b48
fix(pytorch): support MTP in DP/EP piecewise graphs
grimoire
committed
90486c5

Commits on Aug 29, 2026

Merge remote-tracking branch 'upstream/main' into feat/piecewise-cudagraph-runtime
grimoire
committed
f755542
fix: satisfy docstring lint
grimoire
committed
b754d01

Commits on Sep 3, 2026

Merge remote-tracking branch 'upstream/main' into feat/piecewise-cudagraph-runtime
grimoire
committed
60a50cd