Skip to content

feat(inference): cap consecutive SeaCache reuses - #225

Merged
lfengad merged 1 commit into
mainfrom
liangf/sync-seacache-max-consecutive-cached
Aug 29, 2026
Merged

feat(inference): cap consecutive SeaCache reuses#225
lfengad merged 1 commit into
mainfrom
liangf/sync-seacache-max-consecutive-cached

Conversation

@lfengad

@lfengad lfengad commented Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Summary

Sync the SeaCache consecutive-reuse cap from imaginaire4!12068 into the OSS inference stack.

  • tune the default diffusion-cache threshold from 0.35 to 0.25
  • cap consecutive cached residual reuses at 2 by default, per CFG pathway
  • expose diffusion_cache_max_consecutive_cached through setup overrides (0 disables the cap)
  • forward the override into DiffusionCache.Config and include the effective value in startup logging
  • add OSS-path coverage for config validation, state-machine behavior, argument round-trip, and inference forwarding

The production behavior matches the i4 MR; paths and tests are adapted to the OSS repository layout.

Testing

Not run, per request. Static diff and control-flow review completed; git diff --check passes.

@lfengad
lfengad enabled auto-merge (squash) August 28, 2026 17:24
@lfengad
lfengad merged commit b02a3af into main Aug 29, 2026
13 of 17 checks passed
@lfengad
lfengad deleted the liangf/sync-seacache-max-consecutive-cached branch August 29, 2026 02:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants