Prepare one GLM-5.3 Flash TP4 replica to reuse its in-CVM CPU cache through pooled direct transfers, retaining the other replica as the HiCache-disabled control.
The runtime must include the complete hybrid restore correction from sgl-project/sglang#38212, preserve target/MTP/index/recurrent state, and carry no lab scheduler-control hooks. The candidate uses a deployment-configurable total RAM budget (GLM53_HICACHE_RAM_BUDGET, default 80% of available CVM/container RAM at startup), write-through policy and page-first direct I/O; model, TP4/EP4, adaptive EAGLE, serving limits and conversation affinity retain their current settings.
Acceptance:
Native GPU byte tests and CPU regressions are prerequisite evidence; they do not establish TEE/PPCIe performance. No deployment is included in the preparation change.
Runtime preparation PR: #252
Activation PR: #255 (tracking #254). The signed image was published successfully in https://github.com/nearai/cvm-compose-files/actions/runs/34515370239. Scan: zero fixable CRITICAL findings and 62 fixable HIGH findings. Exact-topology staging, rollback qualification and production approval remain pending; no production deployment has been performed.
Prepare one GLM-5.3 Flash TP4 replica to reuse its in-CVM CPU cache through pooled direct transfers, retaining the other replica as the HiCache-disabled control.
The runtime must include the complete hybrid restore correction from sgl-project/sglang#38212, preserve target/MTP/index/recurrent state, and carry no lab scheduler-control hooks. The candidate uses a deployment-configurable total RAM budget (
GLM53_HICACHE_RAM_BUDGET, default 80% of available CVM/container RAM at startup), write-through policy and page-first direct I/O; model, TP4/EP4, adaptive EAGLE, serving limits and conversation affinity retain their current settings.Acceptance:
Native GPU byte tests and CPU regressions are prerequisite evidence; they do not establish TEE/PPCIe performance. No deployment is included in the preparation change.
Runtime preparation PR: #252
Activation PR: #255 (tracking #254). The signed image was published successfully in https://github.com/nearai/cvm-compose-files/actions/runs/34515370239. Scan: zero fixable CRITICAL findings and 62 fixable HIGH findings. Exact-topology staging, rollback qualification and production approval remain pending; no production deployment has been performed.