Skip to content

Use a set difference to release stale deps in cleanup_deps - #194

Merged
Korijn merged 1 commit into
masterfrom
claude/micro-opt-cleanup-deps-set-difference
Jul 10, 2026
Merged

Use a set difference to release stale deps in cleanup_deps#194
Korijn merged 1 commit into
masterfrom
claude/micro-opt-cleanup-deps-set-difference

Conversation

@Korijn

@Korijn Korijn commented Jul 10, 2026

Copy link
Copy Markdown
Collaborator

What

Watcher.cleanup_deps looped over self._deps with a not in self._new_deps containment check per dep. A C-level set difference does the same hash lookups without interpreter overhead per iteration, and yields nothing at all in the steady state where the dep sets are unchanged.

Why

cleanup_deps runs after every watcher evaluation (it's called from the finally of Watcher.get). Measured ~1.5x faster at 5 deps with identical sets (the common case).

Verification

  • pytest tests: 150 passed (includes the dep bookkeeping tests in tests/test_deps.py and lifecycle tests in tests/test_references.py)
  • ruff check and ty check: clean

馃 Generated with Claude Code

https://claude.ai/code/session_01UyALuqgF1ZZ3Lj88FzwGVc


Generated by Claude Code

cleanup_deps runs after every watcher evaluation. Looping over
self._deps with a containment check per dep does the same hash lookups
as a set difference, but with interpreter overhead per iteration; the
C-level difference is ~1.5x faster and yields nothing at all in the
steady state where the dep sets are unchanged.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UyALuqgF1ZZ3Lj88FzwGVc
@Korijn
Korijn merged commit 1889213 into master Jul 10, 2026
11 checks passed
@Korijn
Korijn deleted the claude/micro-opt-cleanup-deps-set-difference branch July 10, 2026 13:33
berendkleinhaneveld added a commit that referenced this pull request Jul 10, 2026
First stable release. Since v0.19.0, observ has had a broad performance
overhaul, gained full type-hint coverage and a new trigger_ref API, and
picked up a documentation site.

New features
- trigger_ref(): force-notify the watchers of a proxy, mirroring Vue's
  triggerRef (#188, closes #123).
- Fully typed: modern type hints throughout, a py.typed marker, and ty
  type-checking enforced in CI (#185, #184, closes #114).

Performance
- Reworked deep-watch traversal: plain leaf values are filtered out of the
  traverse stack at push time and raw targets are traversed directly.
  Traversing large flat/shallow structures is up to ~85% faster (#190).
- Lower per-operation trap overhead and proxies constructed with positional
  flags: reactive reads/writes and proxy creation are ~35-50% faster
  (#192, #193).
- proxy_db lifetimes are managed by reference counting instead of a gc hook,
  eliminating reference cycles and making cleanup deterministic (#177).
- Scheduler and dependency-bookkeeping micro-optimizations: in-place bisect
  insertion (#191), single-read/write flush counting (#196), a set
  difference in cleanup_deps (#194), and reading the arg count off the code
  object in weak() (#195).

Correctness
- Guarantees, with tests, that observ creates no reference cycles (#189).

Documentation
- New MkDocs site published to GitHub Pages (#176), with an Internals
  section (#179) and a rewritten README (#180).

Tooling
- Modernized CI workflows (#182) and a more robust benchmark guard
  (#181, #187).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants