Repository navigation

[3/9] Add disk and shm weight sync for engines without NCCL or CUDA IPC - #4210

Open

HJSang wants to merge 5 commits into

mainfrom

hejian/tpu-host-weight-sync

Open

[3/9] Add disk and shm weight sync for engines without NCCL or CUDA IPC#4210
HJSang wants to merge 5 commits into
mainfrom
hejian/tpu-host-weight-sync

Commits on Oct 27, 2026
- Add disk and shared-memory weight sync for engines without NCCL or CUDA IPC
  
  HJSang
  and
  claude
  committed
  8b33d1a
- Harden disk and shm weight sync against failures and device memory growth
  
  HJSang
  and
  claude
  committed
  c44cf23
- Check shm engines are local with a bind probe instead of Ray's node ip
  
  HJSang
  and
  claude
  committed
  7b78678
- Address review: IPv6 host check, no cached pinned memory, no disk sync for multi-policy
  
  HJSang
  and
  claude
  committed
  ba22690
- Balance disk and shm bucket ownership by bytes instead of round-robin
  
  HJSang
  and
  claude
  committed
  3daf866