Commit 0676ed4
refactor(export): replay the captured kwargs as they are, cache included
The probe now runs layer_inputs[0] verbatim instead of substituting a fresh
past_key_values. A cache only reaches here when the calibration forward loop
left caching on, and by then the layer's amax is already wrong -- every replay
attended over the keys its own earlier replay wrote. Papering over that in
export hides it behind a checkpoint that loads and runs.
PR #2248 owns the real fix and warns at the calibration entry point, which is
where a user can act on it. Letting the probe raise is the better failure until
then: loud, and pointing at the run that produced it.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Signed-off-by: Fridah-nv <201670829+Fridah-nv@users.noreply.github.com>1 parent b78b331 commit 0676ed4
1 file changed
Lines changed: 0 additions & 8 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
290 | 290 | | |
291 | 291 | | |
292 | 292 | | |
293 | | - | |
294 | | - | |
295 | | - | |
296 | | - | |
297 | | - | |
298 | | - | |
299 | | - | |
300 | | - | |
301 | 293 | | |
302 | 294 | | |
303 | 295 | | |
| |||
0 commit comments