Capacity of bucket 13564541 not in witness(still issued in my server)

[0xff0k0a0i]

releated #109

$ stateless-start
2026-06-01T02:21:01.782984Z  INFO stateless_common::logging: Logging initialized (file logging disabled) stdout_filter=info stdout_format=terminal
2026-06-01T02:21:01.702918Z  INFO stateless_validator: [Main] Data directory: /var/lib/megaeth/validator
2026-06-01T02:21:01.702924Z  INFO stateless_validator: [Main] RPC endpoint: https://mainnet.megaeth.com/
2026-06-01T02:21:01.702929Z  INFO stateless_validator: [Main] Witness endpoint: https://mainnet.megaeth.com/rpc
2026-06-01T02:21:01.703679Z  INFO stateless_validator: [Main] Genesis file: /var/lib/megaeth/config/genesis.json
2026-06-01T02:21:01.703688Z  INFO stateless_validator: [metrics] [Metrics] Prometheus exporter listening on 0.0.0.0:9090
2026-06-01T02:21:01.703696Z  INFO stateless_validator: [Main] Metrics enabled on port 9090
2026-06-01T02:21:01.714378Z  INFO stateless_validator: [ChainSpec] Loading genesis from file: /var/lib/megaeth/config/genesis.json
2026-06-01T02:21:01.816617Z  INFO stateless_validator: [Main] Chain spec loaded successfully
2026-06-01T02:21:01.816671Z  INFO stateless_validator: [Main] Continuing from existing canonical chain
2026-06-01T02:21:01.816803Z  INFO stateless_validator: [Main] Number of concurrent tasks: 8
2026-06-01T02:21:01.816808Z  INFO stateless_validator: [Main] Validation result reporting: disabled
2026-06-01T02:21:01.816811Z  INFO stateless_validator: [Chain Sync] Starting with 8 validation workers
2026-06-01T02:21:01.816814Z  INFO stateless_validator: [Chain Sync] Recovering interrupted validation tasks from previous runs...
2026-06-01T02:21:01.818541Z  INFO stateless_validator: [Chain Sync] Task recovery completed
2026-06-01T02:21:01.818549Z  INFO stateless_validator: [Chain Sync] Starting remote chain tracker
2026-06-01T02:21:01.818557Z  INFO stateless_validator: [Chain Sync] Validation reporter disabled (validation reporting not enabled)
2026-06-01T02:21:01.818561Z  INFO stateless_validator: [Chain Sync] Spawning 8 validation workers...
2026-06-01T02:21:01.818572Z  INFO stateless_validator: [Chain Sync] All validation workers started
2026-06-01T02:21:01.818575Z  INFO stateless_validator: [Chain Sync] Starting main synchronizer loop...
2026-06-01T02:21:01.818648Z  INFO validator_core::chain_sync: Starting remote chain tracker lookahead_blocks=80
2026-06-01T02:21:01.818669Z  INFO stateless_validator: [Worker 0] Started
2026-06-01T02:21:01.818688Z ERROR stateless_validator: [Chain Sync] Failed to advance canonical chain: Block validation failed: Block replay failed during transaction execution: internal EVM error occurred when executing transaction 0xff94074650c2d26c796cd3f22a861e865643d22e39aff893ec9247469eee84cc: Capacity of bucket 13564541 not in witness
2026-06-01T02:21:01.818682Z ERROR stateless_validator: [Main] Validator exited with error error=Block validation failed: Block replay failed during transaction execution: internal EVM error occurred when executing transaction 0xff94074650c2d26c796cd3f22a861e865643d22e39aff893ec9247469eee84cc: Capacity of bucket 13564541 not in witness
2026-06-01T02:21:01.818696Z  INFO stateless_validator: [Worker 2] Started
2026-06-01T02:21:01.818702Z  INFO stateless_validator: [Worker 2] Shutting down gracefully
2026-06-01T02:21:01.818707Z  INFO stateless_validator: [Worker 3] Started
2026-06-01T02:21:01.818712Z  INFO stateless_validator: [Worker 5] Started
2026-06-01T02:21:01.818720Z  INFO stateless_validator: [Worker 3] Shutting down gracefully
2026-06-01T02:21:01.818724Z  INFO stateless_validator: [Worker 5] Shutting down gracefully
2026-06-01T02:21:01.818725Z  INFO stateless_validator: [Worker 7] Started
2026-06-01T02:21:01.818732Z  INFO stateless_validator: [Worker 4] Started
2026-06-01T02:21:01.818735Z  INFO stateless_validator: [Worker 7] Shutting down gracefully
2026-06-01T02:21:01.818737Z  INFO stateless_validator: [Worker 4] Shutting down gracefully
2026-06-01T02:21:01.818745Z  INFO stateless_validator: [Worker 1] Started
2026-06-01T02:21:01.818732Z  INFO stateless_validator: [Worker 6] Started
2026-06-01T02:21:01.818751Z  INFO stateless_validator: [Worker 1] Shutting down gracefully
2026-06-01T02:21:01.818751Z  INFO stateless_validator: [Pruner] Starting with interval 300s
2026-06-01T02:21:01.818754Z  INFO stateless_validator: [Worker 6] Shutting down gracefully
2026-06-01T02:21:01.818792Z  INFO stateless_validator: [Tracker] Shutting down gracefully
2026-06-01T02:21:01.820479Z ERROR stateless_validator: [Worker 0] Failed to validate block 17482314: Block replay failed during transaction execution: internal EVM error occurred when executing transaction 0x273b8
6290d587215ae9d89e0bcdcc6255ce0359ea000f288badf38b690e842f96: Capacity of bucket 13564541 not in witness
2026-06-01T02:21:01.884698Z  INFO stateless_validator: [Worker 0] Shutting down gracefully
2026-06-01T02:21:01.884723Z  INFO stateless_validator: [Main] Shutdown complete.
2026-06-01T02:21:01.884733Z  INFO stateless_validator: [Main] Total execution time: 181.811783ms
Error: Block validation failed: Block replay failed during transaction execution: internal EVM error occurred when executing transaction 0xff94074650c2d26c796cd3f22a861e865643d22e39aff893ec9247469eee84cc: Capacity
of bucket 13564541 not in witness

Location:
   bin/stateless-validator/src/main.rs:392:23



$ type stateless-start
stateless-start is aliased to `stateless-validator \
    --data-dir /var/lib/megaeth/validator \
    --rpc-endpoint https://mainnet.megaeth.com/rpc \
    --witness-endpoint https://mainnet.megaeth.com/rpc \
    --genesis-file /var/lib/megaeth/config/genesis.json \
    --metrics-enabled \
    --metrics-port 9090'

Any help?..

[flyq]

After compiling the code using the main branch, it runs normally:

cd stateless-validator

git switch main

cargo build --release -p stateless-validator --bin stateless-validator

./target/release/stateless-validator \
  --data-dir ./validator-data \
  --rpc-endpoint https://mainnet.megaeth.com/rpc \
  --witness-endpoint https://mainnet.megaeth.com/rpc \
  --genesis-file ./test_data/mainnet/genesis.json \
  --start-block 0x63aac1d383966c954470114a3a2f3648de1a4da7562f04119a635bda6162e84c \
  --log.file-directory ./validator-data/logs \
  --data-max-concurrent-requests 4 \
  --witness-max-concurrent-requests 4

the result in ./validator-data/logs/stateless-validator.log:

2026-06-01T03:22:17.546551Z DEBUG stateless_core::pipeline::fetcher: Block sent to pipeline block_number=17482320
2026-06-01T03:22:17.565781Z DEBUG stateless_core::pipeline::fetcher: Block sent to pipeline block_number=17482318
2026-06-01T03:22:17.608776Z DEBUG stateless_core::pipeline::fetcher: Block sent to pipeline block_number=17482319
2026-06-01T03:22:19.875729Z DEBUG stateless_core::executor: Replay block: block_number=17482314, block_hash=0xdaaee737d23790b566824791372808fc3123b08656d89738954cb56612cab216, hardfork=Some(Rex4)
2026-06-01T03:22:20.032960Z DEBUG stateless_validator::chain_sync: Successfully validated block block_number=17482314
2026-06-01T03:22:20.053335Z DEBUG stateless_core::pipeline::advancer: Chain advanced tip=17482314 advanced=1 buffered=0
2026-06-01T03:22:21.963681Z DEBUG stateless_core::executor: Replay block: block_number=17482321, block_hash=0x69fc1f531bd399124547998ae959d810d09acba20f1ca3b1adc95a1ec41fcc1b, hardfork=Some(Rex4)
2026-06-01T03:22:21.971856Z DEBUG stateless_validator::chain_sync: Successfully validated block block_number=17482321

Two points to note: 1. The version of mega-evm must be consistent with its version in the stateless-validator main branch. 2. The hardfork in the Genesis file must include Rex4.

could you show me the result of:

head -n 50 /var/lib/megaeth/config/genesis.json

[0xff0k0a0i]

Oh seem working :)

I missing Release build command

Thanks for help

[flyq]

Could you tell me the differences between your previous and subsequent steps? I think it might be necessary to emphasize some steps in the doc

[0xff0k0a0i]

I was using 2.0.8 version.

after pulling I'm not executed cargo build --release . command.

+) added command sudo cp target/release/stateless-validator /usr/local/bin/stateless-validator

seems not updated bin file