Skip to content

Implement v2 cache API and enhance state management #3683

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 68 commits into from
Aug 24, 2025
Merged

Implement v2 cache API and enhance state management #3683

merged 68 commits into from
Aug 24, 2025

Conversation

@samuelstroschein
Copy link
Member

@samuelstroschein samuelstroschein commented Aug 24, 2025

Implements a caching vtable. Closes opral/lix-sdk#363

Groundwork for more performance improvements controllable by the vtable

@samuelstroschein
implement cache vtable insert logic
dcbacfe
@samuelstroschein
implement selects
c943c83
@samuelstroschein
implement update cache
53e193b
@samuelstroschein
implement mutations
e490069
@samuelstroschein
simplify jsonb
546a84b
@samuelstroschein
reduce bench to 10k
ab40bdd
@samuelstroschein
fix: scoped lix instances
251d213
@samuelstroschein
feat: implement populateStateCacheV2 function and associated tests
3345789
@samuelstroschein
90% done migration to v2 cache api
ac0e217
@samuelstroschein
replace v1 cache with v2 cache
912d764
@samuelstroschein
move transaction state into own folder
036b18d
@samuelstroschein
move cache state logic out of transaction state
21ac7d3
@samuelstroschein
remove insert into transaction state during commit phase
a0eb65b
@samuelstroschein
refactor commit function to improve version context handling and simp…
c75430c 
…lify change processing
@samuelstroschein
move files
a3abe47
@samuelstroschein
add logic to delete untracked state for committed changes to ensure d…
14a7013 
…ata consistency
@samuelstroschein
move change author logic to commit
d67bb83
@samuelstroschein
fix: use static object
bb99146
@samuelstroschein
fix: restore mocks before each test
1011783
@samuelstroschein
refactor: rename updateStateCacheV2 to updateStateCache across tests …
e3da246 
…and implementation
@samuelstroschein
refactor: rename internal_state_cache_v2 to internal_state_cache acro…
260446e 
…ss implementation and tests
@samuelstroschein
remove copy down logic from commit
531eca8 
- too complicated
- too slow
- leads to bugs
@samuelstroschein
refactor: remove debug logging from updateStateCache and commit funct…
ac4845d 
…ions
@samuelstroschein
fix: change author is global
bbd7934
@samuelstroschein
fix: make create comment deterministic
747a372
@samuelstroschein
filter test
2d435ae
@samuelstroschein
test: semantic comparison
95fe477
@samuelstroschein
better wording
0eba5ba
@samuelstroschein
fix: handle transitive inheritance
e1d9eb4
@samuelstroschein
fix: populate inherited state
502e1b4
@samuelstroschein
Add StateWithTombstones types and integrate into schema
7fbc05b
@samuelstroschein
feat: implement mergeVersion function for handling version merges in …
5424711 
…Lix SDK

- Added a new file `merge-version.ts` to manage the merging of versions within the Lix SDK.
- Implemented the `mergeVersion` function to handle the merging logic, including:
  - Transaction management for database operations.
  - Selection of version diffs between source and target versions.
  - Handling of created, updated, and deleted changes.
  - Creation of change sets and commits for both target and global versions.
  - Caching updates for state management after merging.
@samuelstroschein
remove unsued old merge code
8b514a9
@samuelstroschein
move vtable code into folder
19caa51
@samuelstroschein
formatting
d00cc0c
@samuelstroschein
comment out expensive bench
689c3f7
@samuelstroschein
feat: restore and expand LLM rules documentation in AGENTS.md
dafe63a
@samuelstroschein
move table creation in own file
b9acb74
@samuelstroschein
perf: ≈5% faster change inserts
10bea8e
@samuelstroschein
bench: add multi commit benchmark
e929760
@samuelstroschein
bench: add bootup time bench
e917ed4
@samuelstroschein
chore: format
34fcd0a
@samuelstroschein
faster hot path for depth 0 queries
2b4bce6
@changeset-bot
Copy link

changeset-bot bot commented Aug 24, 2025 •
edited
Loading

⚠️ No Changeset found

Latest commit: d02bd15

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@samuelstroschein samuelstroschein temporarily deployed to lixdk-457-partii - prosemirror-example PR #3683 August 24, 2025 20:01 — with Render Destroyed
@nx-cloud
Copy link

nx-cloud bot commented Aug 24, 2025 •
edited
Loading

🤖 Nx Cloud AI Fix Eligible

An automatically generated fix could have helped fix failing tasks for this run, but Self-healing CI is disabled for this workspace. Visit workspace settings to enable it and get automatic fixes in future runs.

To disable these notifications, a workspace admin can disable them in workspace settings.

View your CI Pipeline Execution ↗ for commit 8f89da1

Command Status Duration Result
nx run-many --target=test --parallel ❌ Failed 9m 13s View ↗
nx run-many --target=lint --parallel ✅ Succeeded 48s View ↗

☁️ Nx Cloud last updated this comment at 2025-08-24 20:41:30 UTC

@samuelstroschein samuelstroschein temporarily deployed to lixdk-457-partii - lix-docs PR #3683 August 24, 2025 20:16 — with Render Destroyed
@samuelstroschein samuelstroschein temporarily deployed to lixdk-457-partii - lix-docs PR #3683 August 24, 2025 20:30 — with Render Destroyed
@samuelstroschein samuelstroschein merged commit b5101a3 into main Aug 24, 2025
2 of 4 checks passed
@samuelstroschein samuelstroschein deleted the lixdk-457-partii branch August 24, 2025 20:44
@github-actions github-actions bot locked and limited conversation to collaborators Aug 24, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

implement caching vtable

2 participants

@samuelstroschein