BAD BLOCK vm.opcode.optimize

[bscmevsearcher]

System information

Geth version: 1.6.4
OS & Version: Ubuntu 20.04
Arguments: --cache 60000 --rpc.allow-unprotected-txs --rpc.gascap 0 --discv5 --history.transactions=1 --syncmode=full --db.engine=pebble --state.scheme=path --triesInMemory 64 --history.blocks 115200 --history.logs.disable --enablebal --vm.opcode.optimize

Description

• Steps to reproduce the behaviour
  ...

• Expected behaviour
  ...

• Actual behaviour 1
  t=12-18|17:35:51.766 lvl=info msg="Block synchronisation started"
  t=12-18|17:35:54.092 lvl=info msg="Looking for peers" peercount=5 tried=18 static=0
  t=12-18|17:35:55.103 lvl=error msg=[FALLBACK-EXEC] op=JUMP err="out of gas" gasLeft=3
  t=12-18|17:35:55.103 lvl=error msg=[FALLBACK-EXEC] op=JUMP err="out of gas" gasLeft=3
  t=12-18|17:35:55.174 lvl=error msg="\n########## BAD BLOCK #########\nBlock: 72103125 (0x28bee6d698fc889cbda0d387b9af0507963bce14834c4d05a1b514dcc8d7d4a9)\nMiner: 0x4e5acf9684652BEa56F2f01b7101a225Ee33d23f\nError: expected tx hash 0x2a4c7c38f1dc526a8c1f451bddc7a7cf367b9cfa217e4b31f08a6ef634085404, get 0xdfed2222791d9fcb079da135652e709415c88de1f13e95b1de258c3c936ff280, nonce 13
  63256, to 0x0000000000000000000000000000000000001000, value 1966838900388437, gas 9223372036854775807, gasPrice 0, data f340fa010000000000000000000000004e5acf9684652bea56f2f01b7101a225ee33d23f\nPlatform: geth (devel) go1.24.5 amd64 linux\nVCS: c9d044b2-20250913\nChain config: &params.ChainConfig{ChainID:56, HomesteadBlock:0, DAOForkBlock:, DAOForkSupport:false, EIP150Bloc
  k:0, EIP155Block:0, EIP158Block:0, ByzantiumBlock:0, ConstantinopleBlock:0, PetersburgBlock:0, IstanbulBlock:0, MuirGlacierBlock:0, BerlinBlock:31302048, YoloV3Block:, CatalystBlock:, LondonBlock:31302048, ArrowGlacierBlock:, GrayGlacierBlock:, MergeNetsplitBlock:, ShanghaiTime:(*uint64)(0xc00065adb8), KeplerTime:(uint64)(0xc00065add0), FeynmanTime:(
  uint64)(0xc00065add8), FeynmanFixTime:(*uint64)(0xc00065ade0), CancunTime:(*uint64)(0xc00065ade8), HaberTime:(*uint64)(0xc00065ae20), HaberFixTime:(*uint64)(0xc00065ae28), BohrTime:(*uint64)(0xc00065ae30), PascalTime:(*uint64)(0xc00065ae38), PragueTime:(*uint64)(0xc00065ae40), LorentzTime:(*uint64)(0xc00065ae48), MaxwellTime:(*uint64)(0xc00065ae50), FermiTime:(*uint64)(0xc0006
  5ae58), OsakaTime:(*uint64)(nil), MendelTime:(*uint64)(nil), VerkleTime:(*uint64)(nil), TerminalTotalDifficulty:, TerminalTotalDifficultyPassed:false, DepositContractAddress:0x0000000000000000000000000000000000000000, EnableVerkleAtGenesis:false, RamanujanBlock:0, NielsBlock:0, MirrorSyncBlock:5184000, BrunoBlock:13082000, EulerBlock:18907621, GibbsBlock:23846001, NanoBlock:21962149, MoranBlock:22107423, PlanckBlock:27281024, LubanBlock:29020050, PlatoBlock:30720096, HertzBlock:31302048, HertzfixBlock:34140700, Ethash:(*params.EthashConfig)(nil), Clique:(*params.CliqueConfig)(nil), Parlia:(*params.ParliaConfig)(0x5b25460), BlobScheduleConfig:(*params.BlobScheduleConfig)(0x5ae8580)}\nReceipts: \n##############################\n"
  t=12-18|17:35:55.174 lvl=warn msg="Synchronisation failed, dropping peer" peer=85fd4b8d1ca2eedd1ca18d2bb17a9fc55ab92f9e0e1eb83223aa6137765acfd6 name=Geth/v1.6.4-0f7131f0... td=143623341 err="retrieved hash chain is invalid: expected tx hash 0x2a4c7c38f1dc526a8c1f451bddc7a7cf367b9cfa217e4b31f08a6ef634085404, get 0xdfed2222791d9fcb079da135652e709415c88de1f13e95b1de258c3c936ff280
  , nonce 1363256, to 0x0000000000000000000000000000000000001000, value 1966838900388437, gas 9223372036854775807, gasPrice 0, data f340fa010000000000000000000000004e5acf9684652bea56f2f01b7101a225ee33d23f"
  t=12-18|17:35:55.174 lvl=warn msg="Synchronisation failed, retrying" peer=85fd4b8d1ca2eedd1ca18d2bb17a9fc55ab92f9e0e1eb83223aa6137765acfd6 err="peer is unknown or unhealthy"
  t=12-18|17:35:55.298 lvl=error msg=[FALLBACK-EXEC] op=JUMP err="out of gas" gasLeft=3
  t=12-18|17:35:55.309 lvl=error msg=[FALLBACK-EXEC] op=JUMP err="out of gas" gasLeft=3
  t=12-18|17:35:55.327 lvl=info msg="Skip duplicated bad block" number=72103125 hash=0x28bee6d698fc889cbda0d387b9af0507963bce14834c4d05a1b514dcc8d7d4a9
  t=12-18|17:35:55.327 lvl=error msg="\n########## BAD BLOCK #########\nBlock: 72103125 (0x28bee6d698fc889cbda0d387b9af0507963bce14834c4d05a1b514dcc8d7d4a9)\nMiner: 0x4e5acf9684652BEa56F2f01b7101a225Ee33d23f\nError: expected tx hash 0x2a4c7c38f1dc526a8c1f451bddc7a7cf367b9cfa217e4b31f08a6ef634085404, get 0xdfed2222791d9fcb079da135652e709415c88de1f13e95b1de258c3c936ff280, nonce 1363256, to 0x0000000000000000000000000000000000001000, value 1966838900388437, gas 9223372036854775807, gasPrice 0, data f340fa010000000000000000000000004e5acf9684652bea56f2f01b7101a225ee33d23f\nPlatform: geth (devel) go1.24.5 amd64 linux\nVCS: c9d044b2-20250913\nChain config: &params.ChainConfig{ChainID:56, HomesteadBlock:0, DAOForkBlock:, DAOForkSupport:false, EIP150Block:0, EIP155Block:0, EIP158Block:0, ByzantiumBlock:0, ConstantinopleBlock:0, PetersburgBlock:0, IstanbulBlock:0, MuirGlacierBlock:0, BerlinBlock:31302048, YoloV3Block:, CatalystBlock:, LondonBlock:31302048, ArrowGlacierBlock:, GrayGlacierBlock:, MergeNetsplitBlock:, ShanghaiTime:(*uint64)(0xc00065adb8), KeplerTime:(*uint64)(0xc00065add0), FeynmanTime:(*uint64)(0xc00065add8), FeynmanFixTime:(*uint64)(0xc00065ade0), CancunTime:(*uint64)(0xc00065ade8), HaberTime:(*uint64)(0xc00065ae20), HaberFixTime:(*uint64)(0xc00065ae28), BohrTime:(*uint64)(0xc00065ae30), PascalTime:(*uint64)(0xc00065ae38), PragueTime:(*uint64)(0xc00065ae40), LorentzTime:(*uint64)(0xc00065ae48), MaxwellTime:(*uint64)(0xc00065ae50), FermiTime:(*uint64)(0xc0006
  5ae58), OsakaTime:(*uint64)(nil), MendelTime:(*uint64)(nil), VerkleTime:(*uint64)(nil), TerminalTotalDifficulty:, TerminalTotalDifficultyPassed:false, DepositContractAddress:0x0000000000000000000000000000000000000000, EnableVerkleAtGenesis:false, RamanujanBlock:0, NielsBlock:0, MirrorSyncBlock:5184000, BrunoBlock:13082000, EulerBlock:18907621, GibbsBlock:23846001, NanoBlock:21962149, MoranBlock:22107423, PlanckBlock:27281024, LubanBlock:29020050, PlatoBlock:30720096, HertzBlock:31302048, HertzfixBlock:34140700, Ethash:(*params.EthashConfig)(nil), Clique:(*params.CliqueConfig)(nil), Parlia:(*params.ParliaConfig)(0x5b25460), BlobScheduleConfig:(*params.BlobScheduleConfig)(0x5ae8580)}\nReceipts: \n##############################\n"
  t=12-18|17:35:55.328 lvl=warn msg="Synchronisation failed, dropping peer" peer=f5fa90f8e5712c32711f64d4ad7b7513fc063a974094ec7c499b9f0daf939a37 name=Geth/v1.5.17-d689f3b... td=143623351 err="retrieved hash chain is invalid: expected tx hash 0x2a4c7c38f1dc526a8c1f451bddc7a7cf367b9cfa217e4b31f08a6ef634085404, get 0xdfed2222791d9fcb079da135652e709415c88de1f13e95b1de258c3c936ff280
  , nonce 1363256, to 0x0000000000000000000000000000000000001000, value 1966838900388437, gas 9223372036854775807, gasPrice 0, data f340fa010000000000000000000000004e5acf9684652bea56f2f01b7101a225ee33d23f"
  t=12-18|17:35:55.328 lvl=warn msg="Synchronisation failed, retrying" peer=f5fa90f8e5712c32711f64d4ad7b7513fc063a974094ec7c499b9f0daf939a37 err="peer is unknown or unhealthy"
  t=12-18|17:35:59.654 lvl=warn msg="Peer withheld headers" peer=94925392 advertised=72103158 delivered=72103125
  t=12-18|17:35:59.655 lvl=warn msg="Synchronisation failed, dropping peer" peer=94925392cd53e98202330a080aed02b583052f929a64bc2c3a7ff31f3d3252e4 name=Geth/v1.5.17-85276e6... td=143623323 err="peer is stalling: withheld headers: advertised 72103158, delivered 72103125"
  t=12-18|17:35:59.655 lvl=warn msg="Synchronisation failed, retrying" peer=94925392cd53e98202330a080aed02b583052f929a64bc2c3a7ff31f3d3252e4 err="peer is unknown or unhealthy"
  t=12-18|17:35:59.655 lvl=info msg="Enable transaction acceptance for already in sync."

• Actual behaviour 2
  t=12-18|17:07:31.653 lvl=error msg="\n########## BAD BLOCK #########\nBlock: 72100824 (0xcdb820a4d1e4aede3539452e298611a2dd73b705529f99b989fa746452f0a896)\nMiner: 0x9f1b7FAE54BE07F4FEE34Eb1aaCb39A1F7B6FC92\nError: could not apply tx 145 [0x5a57f5712a6c7b8c86dbc95e67e73f011460d617a2cc2b84e3c1c32e4f2df632]: insufficient funds for gas * price + value: address 0x1266C6bE60392A8Ff3
  46E8d5ECCd3E69dD9c5F20 have 918279038776247 want 935357559150904\nPlatform: geth (devel) go1.24.5 amd64 linux\nVCS: c9d044b2-20250913\nChain config: &params.ChainConfig{ChainID:56, HomesteadBlock:0, DAOForkBlock:, DAOForkSupport:false, EIP150Block:0, EIP155Block:0, EIP158Block:0, ByzantiumBlock:0, ConstantinopleBlock:0, PetersburgBlock:0, IstanbulBlock:0, MuirGlacierBlock
  :0, BerlinBlock:31302048, YoloV3Block:, CatalystBlock:, LondonBlock:31302048, ArrowGlacierBlock:, GrayGlacierBlock:, MergeNetsplitBlock:, ShanghaiTime:(*uint64)(0xc000366108), KeplerTime:(*uint64)(0xc000366130), FeynmanTime:(*uint64)(0xc000366138), FeynmanFixTime:(*uint64)(0xc000366160), CancunTime:(*uint64)(0xc000366168), HaberTime:(*uint64)(0xc000366
  190), HaberFixTime:(*uint64)(0xc000366198), BohrTime:(*uint64)(0xc0003661c0), PascalTime:(*uint64)(0xc0003661c8), PragueTime:(*uint64)(0xc0003661f0), LorentzTime:(*uint64)(0xc0003661f8), MaxwellTime:(*uint64)(0xc000366220), FermiTime:(*uint64)(0xc000366228), OsakaTime:(*uint64)(nil), MendelTime:(*uint64)(nil), VerkleTime:(*uint64)(nil), TerminalTotalDifficulty:, TerminalT
  otalDifficultyPassed:false, DepositContractAddress:0x0000000000000000000000000000000000000000, EnableVerkleAtGenesis:false, RamanujanBlock:0, NielsBlock:0, MirrorSyncBlock:5184000, BrunoBlock:13082000, EulerBlock:18907621, GibbsBlock:23846001, NanoBlock:21962149, MoranBlock:22107423, PlanckBlock:27281024, LubanBlock:29020050, PlatoBlock:30720096, HertzBlock:31302048, HertzfixB
  lock:34140700, Ethash:(*params.EthashConfig)(nil), Clique:(*params.CliqueConfig)(nil), Parlia:(*params.ParliaConfig)(0x5b25460), BlobScheduleConfig:(*params.BlobScheduleConfig)(0x5ae8580)}\nReceipts: \n##############################\n"
  t=12-18|17:07:31.653 lvl=warn msg="Synchronisation failed, dropping peer" peer=b4124cec238a08d4241ceba5f2092a6c85fd79533a29da5cd01b990270c77287 name=Geth/v1.6.4/linux-am... td=143618807 err="retrieved hash chain is invalid: could not apply tx 145 [0x5a57f5712a6c7b8c86dbc95e67e73f011460d617a2cc2b84e3c1c32e4f2df632]: insufficient funds for gas * price + value: address 0x1266C6bE
  60392A8Ff346E8d5ECCd3E69dD9c5F20 have 918279038776247 want 935357559150904"

Hi, my node with option --vm.opcode.optimize cannot sync on latest stable release 1.6.4.

[satyavakya]

I have noticed the same issue

[annielz]

Hi @bscmevsearcher could you kindly inform if this issue occurred right after you started running chain, or if the issue occurred after running the chain for a while, and you restarted the chain & captured the log above?

[bscmevsearcher]

Hi, I added the flag and as soon as I restarted the chain it starts spamming these types of logs.

[annielz]

Hi @bscmevsearcher Thanks for the detailed report, this issue has been fixed in this pr: #3502, and will be merged in later release. Please feel free to patch it in your local environment for now.