EP over RDMA v6: TransportType::PROXY — native dispatch framework - #5

Open

itej89 wants to merge 88 commits into

mainfrom

feat/ibgda-proxy-v6

Commits on Aug 11, 2026

feat(shmem): CPU proxy for IBGDA operations on Pensando AINIC

Tej Kiran
and
claude
committed
e54d0b1
feat(shmem): integrate CPU proxy into MORI SHMEM layer

Tej Kiran
and
claude
committed
5d8813a
fix(ionic): expose ibv_qp/ibv_cq handles for CPU proxy thread

Tej Kiran
and
claude
committed
e04802b
test: cross-NIC DMA capability test for multi-rail approach

Tej Kiran
and
claude
committed
ff9ece2
feat: send-side routing — multi-rail QPs + lkey override

Tej Kiran
and
claude
committed
efa6e45
wip: send-side routing — per-NIC MR + rkey exchange

Tej Kiran
and
claude
committed
51d2607
fix: QP index mapping for proxy — use epIndex-indexed array

Tej Kiran
and
claude
committed
924f285
wip: save progress — need to debug SIGSEGV in proxy EP test

Tej Kiran
and
claude
committed
50759a7
debug: found SIGSEGV crash location — line 345 in setup()

Tej Kiran
and
claude
committed
102db5e
fix: skip parent domain creation in proxy mode to avoid GPU corruption

Tej Kiran
and
claude
committed
e61a4c4
fix: use posix_memalign for proxy ring + document JIT cache invalidation

Tej Kiran
and
claude
committed
62fcf6b
wip: re-enable proxy thread + plain QP + parent domain skip

Tej Kiran
and
claude
committed
3572353
fix: move per-NIC MR to symmetric_memory + skip 0-QP thread + narrow crash

Tej Kiran
and
claude
committed
dcdd2cd
fix: lazy CQ poll + hipHostRegister for GPU-accessible ring

Tej Kiran
and
claude
committed
9bf0280
feat: SEND_WITH_IMM atomic emulation + agreed-rail QP mapping + TC fix

Tej Kiran
and
claude
committed
49b5d3c
fix: uncached VRAM + PCIe read fence for data/signal ordering

Tej Kiran
and
claude
committed
31af7e7
fix: increase recv WR count to 512 per proxy QP

Tej Kiran
and
claude
committed
b4eed72
debug: add trace for uncached symmetric memory allocation path

Tej Kiran
and
claude
committed
3e4fea3
fix: conditional hipSetDevice in proxy thread

Tej Kiran
and
claude
committed
a3a59b4
cleanup: simplify hipSetDevice in proxy MainLoop

Tej Kiran
and
claude
committed
9b769e3
fix: replace SEND_WITH_IMM with RDMA_WRITE for signal delivery

Tej Kiran
and
claude
committed
016a329
feat: hybrid signal delivery — RDMA_WRITE for data signals, SEND_WITH_IMM for barriers

Tej Kiran
and
claude
committed
c50ce8e
fix: increase proxy ring size to 8192 for large token counts

Tej Kiran
and
claude
committed
e4fbddf
fix: increase proxy ring to 64K slots for bench-scale token counts

Tej Kiran
and
claude
committed
a18fd17
fix: remove FENCE from PROXY_SIGNAL_WRITE to unblock bench at scale

Tej Kiran
and
claude
committed
db3a42c
cleanup: remove debug logging from proxy thread

Tej Kiran
and
claude
committed
9243d69
cleanup: remove all debug fprintf from proxy infrastructure

Tej Kiran
and
claude
committed
4b235d1
fix: remove orphaned fprintf arguments from sed cleanup

Tej Kiran
and
claude
committed
bdbbb64
cleanup: remove MoRI-RAIL debug prints from context.cpp

Tej Kiran
and
claude
committed
003cbab
fix: only do per-NIC MR registration for the heap, not sub-allocations

Tej Kiran
and
claude
committed
fba19f7
debug: add minimal traces for vLLM init hang diagnosis

Tej Kiran
and
claude
committed
21da9b6
fix: skip redundant MR registration + Allgather for heap sub-allocations

Tej Kiran
and
claude
committed
47770c2
feat: per-NIC proxy threads + targeted quiet for 3.4x dispatch speedup

Tej Kiran
and
claude
committed
76e5162

Commits on Aug 12, 2026

v5: Full kernel separation — GpuStates clean, separate ProxyGpuState

Tej Kiran
and
claude
committed
e1622ce
v5: Fix proxy dispatch for Warp/Block scope — root cause of AINIC hang

Tej Kiran
and
claude
committed
46c069a
v5: Remove debug traces from init.cpp and runtime.cpp

Tej Kiran
and
claude
committed
8eec84b
v5: Gate application layer proxy changes behind env var

Tej Kiran
and
claude
committed
a841a66
v5: Consolidate env var to MORI_EP_OVER_RDMA only

Tej Kiran
and
claude
committed
49c405d
v5: Revert shmem_ibgda_kernels.hpp to main — no proxy changes needed

Tej Kiran
and
claude
committed
82870eb
v5: Minimal shmem_device_api.hpp — keep original macros, add one guard line each

Tej Kiran
and
claude
committed
0e7968e
v5: Simplify proxy guard to just #ifdef MORI_PROXY_ENABLED

Tej Kiran
and
claude
committed
1fb0510
v6: Use TransportType::PROXY — native dispatch framework

Tej Kiran
and
claude
committed
9cc3949
v6: Gate proxy dispatch branches with #ifdef MORI_PROXY_ENABLED

Tej Kiran
and
claude
committed
bc08dfc
v6: Fix template specialization signatures and long/unsigned long redefs

Tej Kiran
and
claude
committed
f329260
v6: Remove address-based overloads, fix duplicate GetGlobalProxyStatePtr

Tej Kiran
and
claude
committed
236673b
v6: Add address-based and signal stubs for all kernel templates

Tej Kiran
and
claude
committed
3e98858
refactor: consolidate MORI_EP_OVER_RDMA env var checks

Tej Kiran
and
claude
committed
7947482
cleanup: move shmem_proxy_state.hpp include to top of internal.hpp

Tej Kiran
and
claude
committed
e1fc7dc
feat: add ProxyGpuStates as subclass of GpuStates

Tej Kiran
and
claude
committed
f3027ee
cleanup: remove tp8-1p1d-bench skill file

Tej Kiran
and
claude
committed
0cc49b9
refactor: use ProxyGpuStates as single gpuStates in ShmemStates

Tej Kiran
and
claude
committed
b79a125
refactor: single-symbol copy with size gated on proxy active

Tej Kiran
and
claude
committed
cfd8cdc
refactor: use Context::IsProxyEnabled() for copy size gate

Tej Kiran
and
claude
committed
55caf81
cleanup: tidy internal.hpp — remove proxy_state include, move forward decl

Tej Kiran
and
claude
committed
485dda6
refactor: move proxyThreads to init.cpp file-local, use IsProxyEnabled()

Tej Kiran
and
claude
committed
602833e
cleanup: use inherited ProxyGpuStates in shmem.hpp weak symbol

Tej Kiran
and
claude
committed
bd0064a
cleanup: delete shmem_proxy_state.hpp, fix shmem.hpp two-symbol approach

Tej Kiran
and
claude
committed
e6d4e88
refactor: align ProxyGpuStates name, move extern + getter to internal.hpp

Tej Kiran
and
claude
committed
7082cb2
fix: restore assert(false) fallthrough in dispatch macros

Tej Kiran
and
claude
committed
5a3963a
fix: restore separate GpuStates + ProxyGpuStates in ShmemStates

Tej Kiran
and
claude
committed
f29f4f0
rename: proxyGpuState → proxyGpuStates in ShmemStates

Tej Kiran
and
claude
committed
5564238
fix: update init.cpp and runtime.cpp for standalone ProxyGpuStates

Tej Kiran
and
claude
committed
b9c02da
cleanup: remove ProxyGpuStates.active field

Tej Kiran
and
claude
committed
433d1e4
refactor: use proxyEnabled directly in context.cpp, clean if/else paths

Tej Kiran
and
claude
committed
bb8e8b1
fix: remove unnecessary (int) cast to match main

Tej Kiran
and
claude
committed
8ecc796
refactor: clean if/else separation in BuildAndConnectInitialEndpoints

Tej Kiran
and
claude
committed
933f8c5
refactor: add GetRailContext() helper, deduplicate agreed-rail formula

Tej Kiran
and
claude
committed
5f76d30
cleanup: symmetric_memory.cpp — remove debug fprintf, use IsProxyEnabled()

Tej Kiran
and
claude
committed
c5e2806
refactor: keep main's MR registration untouched, single proxy if block

Tej Kiran
and
claude
committed
7547d18
refactor: optimize proxy sub-allocation path, keep native untouched

Tej Kiran
and
claude
committed
c8b8196
refactor: cache proxyEnabled in IonicDeviceContext constructor

Tej Kiran
and
claude
committed
ef8c6ac
cleanup: remove dead duplicate proxy QP block in ionic.cpp

Tej Kiran
and
claude
committed
397aaed
fix: restore commented-out cqPool.insert from main

Tej Kiran
and
claude
committed
aa7e241
fix: reorder cqPool/qpPool insert before ibv handle expose

Tej Kiran
and
claude
committed
c267827
cleanup: remove ibvHandle expose from native IBGDA path

Tej Kiran
and
claude
committed
4b06cbe
cleanup: deduplicate MORI_DEFINE_GPU_STATES macro

Tej Kiran
and
claude
committed
0b19f69
fix: add VMM heap support to proxy PutMemNbi and PutSizeImmNbi

Tej Kiran
and
claude
committed
3634247
fix: rename PROXY_STATE_MAX_NICS → PROXY_MAX_NICS in init.cpp

Tej Kiran
and
claude
committed
e469c21
debug: add traces for hang diagnosis

Tej Kiran
and
claude
committed
60a7674
debug: add more traces for hang diagnosis (iteration 3)

Tej Kiran
and
claude
committed
d72e52c
debug: add proxy thread traces for perf diagnosis

Tej Kiran
and
claude
committed
555b69e
debug: add thread count trace
Tej Kiran
committed
02d4209
fix: gate Warp/Block proxy kernels on lane 0 / thread 0

Tej Kiran
and
claude
committed
3171441
Revert "fix: gate Warp/Block proxy kernels on lane 0 / thread 0"
Tej Kiran
committed
9ed32f2
debug: add proxy thread ops counter on shutdown
Tej Kiran
committed
90d8b7b
fix: gate Warp/Block proxy kernels on lane 0 / thread 0

Tej Kiran
and
claude
committed
546155b

Commits on Aug 13, 2026

perf: symmetric agreed-rail formula for even NIC distribution

Tej Kiran
and
claude
committed
7e010ad
Revert "perf: symmetric agreed-rail formula for even NIC distribution"
Tej Kiran
committed
13bf51d