Repository navigation

Compute log probs with one plain-torch vocab-parallel cross entropy, without Megatron - #4315

Open

HJSang wants to merge 9 commits into

hjsang/pip-wheelfrom

hjsang/native-vocab-ce

Open

Compute log probs with one plain-torch vocab-parallel cross entropy, without Megatron#4315
HJSang wants to merge 9 commits into
hjsang/pip-wheelfrom
hjsang/native-vocab-ce

Commits on Oct 27, 2026
- Compute log probs without Megatron when it is not installed
  
  HJSang
  and
  claude
  committed
  5da8ae3
- test: compute_log_probs returns [seq, 1]
  
  HJSang
  and
  claude
  committed
  137c787
- test: share one process group per tensor-parallel size
  
  HJSang
  and
  claude
  committed
  804331e
- Check megatron.core, and let the fallback take the default group as None
  
  HJSang
  and
  claude
  committed
  c595146
- Fallback cross entropy: one copy, then in place as Megatron's kernel
  
  HJSang
  and
  claude
  committed
  cd5e45a
- Stop calling the plain-torch cross entropy "fused" in compute_log_probs
  
  HJSang
  and
  claude
  committed
  e305343
- Trim the comments in the Megatron-free cross entropy
  
  HJSang
  and
  claude
  committed
  752a065
- Use the torch vocab-parallel cross entropy on every install
  
  HJSang
  and
  claude
  committed
  46c51b2
- Fail loudly on a None group; drop the last Megatron import from the log-prob path
  
  HJSang
  and
  claude
  committed
  9022cb2