parallel commitment calculations implemented#20805

Open

mh0lt wants to merge 105 commits intomainfrom

exec3/remove-rwtx-threading-merge-main

Commits on Mar 18, 2026

Commits on Mar 19, 2026

state: fix storage revert case with domain pre-check in applyVersionedWrites

Mark Holt
and
claude
committed
stagedsync: fix build — revert uncommitted SwapUpdates/ProcessBAL/commitmentCalculator

Mark Holt
and
claude
committed
stagedsync, state: fix parallel executor cross-thread race + stateObject cache staleness

Mark Holt
and
claude
committed

Commits on Mar 20, 2026

stagedsync, state, exec: BlockStateCache + all-fields LightCollector + remove BufferedReader

Mark Holt
and
claude
committed
state: extend BlockStateCache to also cache storage reads

Mark Holt
and
claude
committed
stagedsync, state, exec: BlockStateCache write buffer + flush-time dedup

Mark Holt
and
claude
committed
stagedsync: move all ApplyStateWrites + finalize to execLoop

Mark Holt
and
claude
committed
stagedsync: move all ApplyStateWrites + finalize to execLoop

Mark Holt
and
claude
committed
stagedsync, state: finalize reads from BlockStateCache + cleanup nextResult

Mark Holt
and
claude
committed

Commits on Mar 21, 2026

stagedsync, state: move all ApplyStateWrites + finalize to execLoop

Mark Holt
and
claude
committed
stagedsync: fix finalizeTx Version on coinbase/burnt versionMap writes

Mark Holt
and
claude
committed
stagedsync: fix finalizeTx Version on coinbase/burnt versionMap writes

Mark Holt
and
claude
committed
state: reset accessList and transientStorage in IBS.Reset()

Mark Holt
and
claude
committed
state: refresh CodeHash from versionMap on stateObject cache hit

Mark Holt
and
claude
committed
state: read code from versionMap in parallel stateObject.Code()

Mark Holt
and
claude
committed
stagedsync, state: split fee logic — finalizeTxSimple + restore cross-check

Mark Holt
and
claude
committed
stagedsync, state: fix finalizeTxSimple to include execution effects

Mark Holt
and
claude
committed
state: skip step-boundary commitment when step is already frozen

Mark Holt
and
claude
committed
stagedsync, state: skip commitment at frozen step boundaries

Mark Holt
and
claude
committed
stagedsync: add finalizeTxSimple unit tests + fix lightcollector test args

Mark Holt
and
claude
committed

Commits on Mar 22, 2026

state: read current storage from BlockStateCache in CachedReaderV3

Mark Holt
and
claude
committed
state: add parallel executor fix tests + fix infinite incarnation loop

Mark Holt
and
claude
committed
state: restore working validation cross-check from successful 3049-block run

Mark Holt
and
claude
committed
state: restore current storage read + None crosscheck from successful run

Mark Holt
and
claude
committed
state: remove duplicate GetCurrentStorage check + cleanup debug traces

Mark Holt
and
claude
committed
state: remove None crosscheck — field-level BalancePath reads handle validation

Mark Holt
and
claude
committed
state: add value tiebreaker to validation — avoid false invalidation

Mark Holt
and
claude
committed
state: add unit tests for parallel executor fixes

Mark Holt
and
claude
committed
state: add unit tests for parallel executor fixes

Mark Holt
and
claude
committed
stagedsync: remove blockApplied synchronization — execLoop runs continuously

Mark Holt
and
claude
committed
state: add system call storage propagation tests

Mark Holt
and
claude
committed
stagedsync: add commitment calculator with fan-out from execLoop

Mark Holt
and
claude
committed
commitment: add calculator correctness tests

Mark Holt
and
claude
committed
commitment: add calculator touches tests

Mark Holt
and
claude
committed

Commits on Mar 23, 2026

state: add ToTouchKeys for commitment calculator serialization

Mark Holt
and
claude
committed
commitment: add TouchPlainKeyDirect for commitment calculator

Mark Holt
and
claude
committed
state: replace ToTouchKeys/AsStateUpdates with TouchUpdates

Mark Holt
and
claude
committed
stagedsync, commitment: wire commitment calculator with TouchUpdates

Mark Holt
and
claude
committed
stagedsync: move commitment to calculator goroutine, remove inline path

Mark Holt
and
claude
committed
stagedsync, db: disable inline TouchKey when calculator owns Updates

Mark Holt
and
claude
committed
state, db: skip inline ComputeCommitment when calculator active

Mark Holt
and
claude
committed
stagedsync, commitment: calculator owns its own Updates buffer

Mark Holt
and
claude
committed
state: guard ALL direct TouchKey calls when calculator owns Updates

Mark Holt
and
claude
committed
stagedsync: make trie root mismatch fatal + fix drainBeforeExit deadlock

Mark Holt
and
claude
committed
stagedsync: skip per-block commitment in calculator, fix deadlock

Mark Holt
and
claude
committed
stagedsync: wrap finalize error as ErrInvalidBlock + skip per-block commitment

Mark Holt
and
claude
committed
stagedsync: add BAD_BLOCK_HALT env var, fix STOP_AFTER_BLOCK (cherry-pick #19803)

Mark Holt
and
claude
committed

Commits on Mar 29, 2026

stagedsync: per-block commitment calculator with calcState accumulator and asOfStateReader

Mark Holt
and
claude
committed
stagedsync: recover from send on closed commitResults channel

Mark Holt
and
claude
committed
stagedsync: exec loop owns batch lifecycle, closes channels on exit

Mark Holt
and
claude
committed

Commits on Mar 31, 2026

stagedsync, state: fix SetCode revert-to-original + batch commitment trigger + overlay stage updates

Mark Holt
and
claude
committed

Commits on Apr 2, 2026

stagedsync: fix finalization syscall reads + BAL db.View deadlock

Mark Holt
and
claude
committed

Commits on Apr 3, 2026

stagedsync: fix finalization syscall reads + BAL db.View deadlock

Mark Holt
and
claude
committed
db: add ForEach/ForAmount to OverlayReadView for post-snapshot block reads

Mark Holt
and
claude
committed
exec: wrap worker roTx with BlockOverlay for BLOCKHASH lookups

Mark Holt
and
claude
committed

Commits on Apr 4, 2026

stagedsync: remove pe.exec() flush — stageloop owns flush lifecycle

Mark Holt
and
claude
committed
stagedsync: prune ChangeSets3 unconditionally when past MaxReorgDepth

Mark Holt
and
claude
committed

Commits on Apr 5, 2026

exec, db: fix worker roTx leak + add MDBX commit diagnostics

Mark Holt
and
claude
committed

Commits on Apr 6, 2026

stagedsync: split prune into separate transaction for MDBX page reclamation

Mark Holt
and
claude
committed
stagedsync: synchronous collate when stepsInDB > 2

Mark Holt
and
claude
committed
execmodule, stagedsync: split prune + sync collate in FCU path

Mark Holt
and
claude
committed
db, execmodule, stagedsync: consolidate collate+prune into Aggregator.CollateAndPruneIfNeeded

Mark Holt
and
claude
committed

Commits on Apr 7, 2026

exec3, mdbx: fix executeBlocks ctx.Done break + add MDBX TX tracking

Mark Holt
and
claude
committed
exec3: fix executeBlocks errgroup lifecycle + channel close ownership

Mark Holt
and
claude
committed
sentry, exec3: cache StatusDataProvider + fix channel ownership + min batch blocks

Mark Holt
and
claude
committed
exec3: cap BuildFilesInBackground to block file boundary

Mark Holt
and
claude
committed
exec3: close exec loop's pe.applyTx on exit — fixes RO tx leak

Mark Holt
and
claude
committed
forkchoice: close roTx before commit for MDBX GC page reclamation

Mark Holt
and
claude
committed

Commits on Apr 12, 2026

db: atomic per-key prune deletion, ViewID fix, collation step assertion

authored and
Mark Holt
committed

Commits on Apr 19, 2026

Commits on Apr 20, 2026

WIP: nonce fix (HistoryReaderV3 sd-chain) + accessList.Reset adapter
Mark Holt
committed
stageloop: hardcode inMemHistoryReads=true (correctness requirement)
Mark Holt
committed

Commits on Apr 23, 2026

WIP: parallel-executor trie-race fixes + dump-on-mismatch infra

Mark Holt
and
claude
committed
Merge origin/main into exec3/remove-rwtx-threading

Mark Holt
and
claude
committed

Commits on Apr 24, 2026

execmodule/forkchoice: release bgRoTx before RW commit to drop openTxs 2→1

Mark Holt
and
claude
committed
execmodule: two more openTxs=2 eliminations — ValidateChain + CommitCycle

Mark Holt
and
claude
committed
db/kv/mdbx: tx-lifecycle tracer (OPEN/COMMIT/ROLLBACK with traceID + stack)

Mark Holt
and
claude
committed
stagedsync: port commitment calculator architecture forward onto merged branch

Mark Holt
and
claude
committed

Commits on Apr 25, 2026

db/kv: GatedRoDB wrapper + BlockRetire commit-gate wiring

Mark Holt
and
claude
committed
db/kv/mdbx: env-gated tx-lifecycle tracer + concurrent-tx dump

Mark Holt
and
claude
committed

Commits on Apr 26, 2026

stagedsync, commitment, db/state, execution/protocol: remove leftover debug Printfs

Mark Holt
and
claude
committed
execmodule, db/kv/mdbx: track lastFlushedCommitmentTxNum on FCU + gate per-commit log

Mark Holt
and
claude
committed
execmodule, db/state: kick CollateAndPruneIfNeeded on FCU + adaptive prune budget

Mark Holt
and
claude
committed

Commits on Apr 27, 2026

merge main + address PR #20805 review feedback

Mark Holt
and
claude
committed
Merge remote-tracking branch 'origin/main' into exec3/remove-rwtx-threading-merge-main
Mark Holt
committed
commitment, state: fix CI test failures from PR review round 2

Mark Holt
and
claude
committed
commitment: skip Test_ModeUpdate_SiblingConsistency pending fix

Mark Holt
and
claude
committed
state: LightCollector emits only changed account fields

Mark Holt
and
claude
committed

Commits on Apr 28, 2026

state, commitment, execmodule, stagedsync, db: address PR #20805 round-2 review feedback

Mark Holt
and
claude
committed
state: fix VersionedWrites selfdestruct strip to be order-independent

Mark Holt
and
claude
committed
Merge remote-tracking branch 'origin/main' into exec3/remove-rwtx-threading-merge-main
Mark Holt
committed
execmodule, stagedsync: fix parallel-exec fork validation

Mark Holt
and
claude
committed
Merge remote-tracking branch 'origin/main' into exec3/remove-rwtx-threading-merge-main
Mark Holt
committed
stagedsync: fix Amsterdam block-gas accumulation in parallel exec

Mark Holt
and
claude
committed
stagedsync: move parallel-exec changeset accumulator to exec loop

Mark Holt
and
claude
committed
stagedsync: move parallel-exec ApplyTxIndexes to exec loop

Mark Holt
and
claude
committed