Block Can't Create & Sync

[avenbreaks]

Block Can't Create & Sync

Description

I can't connect to bootnodes and can't build new blocks, I'm running 4 nodes in the cloud, and tcp udp firewall is open but no response from polygon-edge. any suggestions ?

Your environment

Golang: Go 1.20
Polygon-Edge: v1.3.1
Firewall : All tcp udp opened

Logs

2024-01-04T09:17:51.136Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=2
2024-01-04T09:17:51.137Z [INFO]  polygon.server.ibft.consensus: round started: round=3
2024-01-04T09:17:51.137Z [DEBUG] polygon.server.ibft.consensus: enter: new round state
2024-01-04T09:17:51.138Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=3 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a
2024-01-04T09:19:13.138Z [DEBUG] polygon.server.ibft.consensus: exit: new round state
2024-01-04T09:19:13.138Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=3
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: round started: round=4
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-01-04T09:19:13.140Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=4 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a

[avenbreaks]

@Stefan-Ethernal

[avenbreaks]

Block Can't Create & Sync

Description

I can't connect to bootnodes and can't build new blocks, I'm running 4 nodes in the cloud, and tcp udp firewall is open but no response from polygon-edge. any suggestions ?

Your environment

Golang: Go 1.20 Polygon-Edge: v1.3.1 Firewall : All tcp udp opened

Logs

2024-01-04T09:17:51.136Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=2
2024-01-04T09:17:51.137Z [INFO]  polygon.server.ibft.consensus: round started: round=3
2024-01-04T09:17:51.137Z [DEBUG] polygon.server.ibft.consensus: enter: new round state
2024-01-04T09:17:51.138Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=3 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a
2024-01-04T09:19:13.138Z [DEBUG] polygon.server.ibft.consensus: exit: new round state
2024-01-04T09:19:13.138Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=3
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: round started: round=4
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-01-04T09:19:13.140Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=4 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a

solved, but got issue on create contract using remix

Gas estimation failed
Gas estimation errored with the following message (see below). The transaction execution will likely fail. Do you want to force sending?
Returned error: opcode not found

What the best set the gas fee on chain?

[RonTuretzky]

wait when you go to the node rpc port in browser what do you get as a result?
if the networking part works you should get something like

{"name":"","chain_id":<network_id>,"version":""}

[uri-lightblocks]

@avenbreaks how did you solve the issue with nodes not creating new blocks?
cc: @RonTuretzky , @Stefan-Ethernal
I have the same issue. 4 nodes all are with --seal

2024-01-27T08:37:43.928Z [INFO]  polygon.server.polybft.consensus_runtime: Proposer calculated: height=1176037 round=2 address=0xd04Ddf207f8579a1C7466784027B90414735807E
2024-01-27T08:37:43.928Z [INFO]  polygon.server.polybft: we are the proposer
2024-01-27T08:38:23.927Z [ERROR] polygon.server.polybft: unable to build proposal
2024-01-27T08:38:23.927Z [INFO]  polygon.server.polybft: round timeout expired: round=2
2024-01-27T08:38:23.928Z [INFO]  polygon.server.polybft: round started: round=3

The only place I find the error unable to build proposal without any other text is in ibft, but I use polybft

the part from genesis.json

 "engine": {
            "polybft": {
                "initialValidatorSet": [
                    {
                        "address": "0xBB506E51b797674c08509527e3E607a75A20F0cF",
...
                    },
                    {
                        "address": "0xd04Ddf207f8579a1C7466784027B90414735807E",
...
                    },
                    {
                        "address": "0x7c8dc82c15abc3f69170C02fe3494281343D4e26",
...
                    },
                    {
                        "address": "0xe3C1bEFE56fEDaC226A177b40792bad8FA79C321",
...
                    }
                ],

[spudgy]

I am having the same issue, no new blocks
Only round timeout

[RonTuretzky]

I am having the same issue, no new blocks
Only round timeout

If you restart the binary, does proposer calculation happen then ~10 block rounds? @spudgy

[spudgy]

Not really, I'v reached full disk limit and since than my docker won't mint any new blocks even after cleaning up some space.

[RonTuretzky]

Not really, I'v reached full disk limit and since than my docker won't mint any new blocks even after cleaning up some space.

Share the errors ?

[spudgy]

I'm using v1.1.0

2024-02-15T20:51:55.258Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=0
2024-02-15T20:51:55.260Z [INFO]  polygon.server.ibft.consensus: round started: round=1
2024-02-15T20:51:55.261Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-02-15T20:51:59.921Z [INFO]  polygon.server.jsonrpc: Websocket connection established
2024-02-15T20:52:17.260Z [ERROR] polygon.server.ibft.consensus: unable to build proposal
2024-02-15T20:52:17.260Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=1
2024-02-15T20:52:17.262Z [INFO]  polygon.server.ibft.consensus: round started: round=2
2024-02-15T20:52:22.695Z [INFO]  polygon.server.jsonrpc: Websocket connection established


2024-02-15T20:53:28.017Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-02-15T20:53:32.015Z [INFO]  polygon.server.ibft: executed txs: successful=0 failed=0 skipped=0 remaining=0
2024-02-15T20:53:32.018Z [INFO]  polygon.server.ibft: build block: number=935722 txs=0
2024-02-15T20:53:50.020Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=1
2024-02-15T20:53:50.022Z [INFO]  polygon.server.ibft.consensus: round started: round=2```

[RonTuretzky]

Did you try creating a backup and restoring to an earlier block? Also ibft has the regenesis command

[doviethoang]

same issue with @spudgy pudgy
Have you guys fixxed it ?
Oct 17 04:29:27 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:29:27.441Z [ERROR] polygon.server.ibft.consensus: unable to build proposal
Oct 17 04:29:27 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:29:27.441Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=2
Oct 17 04:29:27 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:29:27.442Z [INFO] polygon.server.ibft.consensus: round started: round=3
Oct 17 04:30:50 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:30:50.443Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=3
Oct 17 04:30:50 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:30:50.444Z [INFO] polygon.server.ibft.consensus: round started: round=4
Oct 17 04:33:33 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:33.446Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=4
Oct 17 04:33:33 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:33.447Z [INFO] polygon.server.ibft.consensus: round started: round=5
Oct 17 04:33:33 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:33.448Z [INFO] polygon.server.ibft.consensus: we are the proposer
Oct 17 04:33:42 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:42.000Z [INFO] polygon.server.ibft: executed txs: successful=0 failed=0 skipped=0 remaining=0
Oct 17 04:33:42 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:42.000Z [INFO] polygon.server.ibft: build block: number=4058425 txs=0
Oct 17 04:38:56 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:38:56.448Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=5
Oct 17 04:38:56 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:38:56.450Z [INFO] polygon.server.ibft.consensus: round started: round=6
I haved restart 3 validator nodes and still the same error