Draft: progressive + streaming ingestion; converging estimates; simplified facets (targets main) #107
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
This PR will trigger a minor release when merged. |
trieloff
changed the title
trieloff
force-pushed
the
feat/progressive-incremental-worker
branch
from
9c825e7 to
de9cecb
Compare
…ngDataChunks); demo; docs; exports Signed-off-by: Lars Trieloff <[email protected]>
trieloff
force-pushed
the
feat/progressive-incremental-worker
branch
from
de9cecb to
372d86f
Compare
…error handling; keep API compatible Signed-off-by: Lars Trieloff <[email protected]>
… errors to inflight Signed-off-by: Lars Trieloff <[email protected]>
…on + client shim; update demo/tests/docs accordingly Signed-off-by: Lars Trieloff <[email protected]>
…repo config unchanged; limit lint scope to PR files Signed-off-by: Lars Trieloff <[email protected]>
… issues post-merge Signed-off-by: Lars Trieloff <[email protected]>
…ERVAL_MS from engine.js and replace inline epsilon usage Signed-off-by: Lars Trieloff <[email protected]>
…js and remove inline 1e-9 Signed-off-by: Lars Trieloff <[email protected]>
…VANCE; remove magic numbers; reuse DataChunks; make auto-advance interval configurable; add onError; bound loadedSlices via maxSlices; add restart mutex/seq Signed-off-by: Lars Trieloff <[email protected]>
…timates semantics Signed-off-by: Lars Trieloff <[email protected]>
…dd fake-worker browser tests for onError and maxSlices replay bound Signed-off-by: Lars Trieloff <[email protected]>
…n-import to 2.32.0; regenerate lock for npm ci Signed-off-by: Lars Trieloff <[email protected]>
…lt shape Signed-off-by: Lars Trieloff <[email protected]>
…ops) Signed-off-by: Lars Trieloff <[email protected]>
… worker to merge shards in-worker; wrapper supports shards with in-worker merging and prefers mergeable quantiles Signed-off-by: Lars Trieloff <[email protected]>
…ions Signed-off-by: Lars Trieloff <[email protected]>
Signed-off-by: Lars Trieloff <[email protected]>
…s orchestrator and displays shard count in UI Signed-off-by: Lars Trieloff <[email protected]>
…s it to stream:add/phase/end to avoid 'no streaming run' errors; resolves demo parallel errors Signed-off-by: Lars Trieloff <[email protected]>
…arallelism Signed-off-by: Lars Trieloff <[email protected]>
… close previous run on restart to avoid orphaned workers Signed-off-by: Lars Trieloff <[email protected]>
…to prevent duplicate stream:init and runaway worker spawning; eliminates phantom second run with 0 ingestion Signed-off-by: Lars Trieloff <[email protected]>
…s pending timers on Done to prevent late finalize from spawning a new run Signed-off-by: Lars Trieloff <[email protected]>
…to avoid flakiness on earliest frames; CI-friendly Signed-off-by: Lars Trieloff <[email protected]>
…h COOP/COEP devServer config Signed-off-by: Lars Trieloff <[email protected]>
…ium can spawn nested workers Signed-off-by: Lars Trieloff <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Title: Draft: progressive + streaming ingestion; converging estimates; simplified facets (targets main)
This draft PR against
maintracks the implementation in #106 (prerelease).Highlights
Please review details, discussion, and validation in #106.