Search results

[Bug] Eagle3 training for gpt-oss-120b fails with OOM

Status: Open.

#326 In sgl-project/SpecForge;

· gopalsarda opened on Nov 25, 2025

EAGLE3 on Qwen2.5-VL / Qwen3-VL shows extremely low accept length (accept_len ≈ 1)

bugSomething isn't workingSomething isn't working

low accuracy

Status: Open.

#310 In sgl-project/SpecForge;

· C3236455482 opened on Nov 19, 2025

[Bug] 0.00 acc at the start of finetuning pretrained draft model from huggingface

bugSomething isn't workingSomething isn't working

low accuracy

Status: Open.

#300 In sgl-project/SpecForge;

· AxeCameron777 opened on Nov 14, 2025

[RFC]: Integrate USP (Ulysses + Ring Attention) for Context Parallelism in SpecForge

enhancementNew feature or requestNew feature or request

feature

Status: Open.

#299 In sgl-project/SpecForge;

· uygnef opened on Nov 13, 2025

[Feature] Does SpecForge support using quantized models as the target model?

Status: Open.

#294 In sgl-project/SpecForge;

· abc123000111 opened on Nov 12, 2025

[Bug] Missing specforge.modeling.target.sgl_model_wrapper import SglangTargetModel

Status: Open.

#292 In sgl-project/SpecForge;

· jianc99 opened on Nov 12, 2025

[Question] --max-length parameter actually determine when training a draft model

Status: Open.

#289 In sgl-project/SpecForge;

· xinjiahui opened on Nov 10, 2025

[Bug] prepare_hidden_states.py needs sglang==0.5.3 or lower

Status: Open.

#274 In sgl-project/SpecForge;

· xhdidi opened on Nov 4, 2025

[Question] Why d2t = [target_token_ids] - torch.arange(len)?

Status: Open.

#272 In sgl-project/SpecForge;

· Tomorrowdawn opened on Oct 31, 2025

[Bug] RuntimeError: can't start new thread

Status: Open.

#264 In sgl-project/SpecForge;

· Sayandip170900 opened on Oct 28, 2025

[Bug] Training Eagle3 for gpt-oss-120b fails with <code>AttributeError: 'NoneType' object has no attribute 'evictable_size'</code>

Status: Open.

#263 In sgl-project/SpecForge;

· gopalsarda opened on Oct 26, 2025

[Question] A little doubt about the draft training of VL model

Status: Open.

#260 In sgl-project/SpecForge;

· Arcmoon-Hu opened on Oct 23, 2025