Customize Data Retention in Pruned Observation Nodes

[gitmewai]

Hello,

We would like to setup our flare/songbird observation nodes to keep only the most recent 2 weeks of data.

We tested with the "pruning-enabled": true in config.json. However, this only keeps the block history in the last hour roughly.

How can we customize the nodes in order to retain 2 weeks of data?

Many thanks.

[gitmewai]

I tested with the current block 0x5a0d3a5 and this block is gone on my node at 0x5a0d3ce in 40 seconds with the error required historical state unavailable:

date ; curl -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":1}' https://songbird-api.flare.network/ext/C/rpc
Tue 17 Jun 2025 12:35:32 BST
{"jsonrpc":"2.0","id":1,"result":"0x5a0d3a5"}
user@sgb-node % date ; curl -s -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"debug_traceBlockByNumber","params":["0x5a0d3a5", {"tracer": "callTracer"}],"id":1}' http://sgb01.node.local:9650/ext/C/rpc
Tue 17 Jun 2025 12:35:49 BST
{"jsonrpc":"2.0","id":1,"result":[{"result":{"type":"CALL","from":"0xb9f0f796bebca28c9813452c9b1b5719d89604e3","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x5237","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010ce0149d0628c389b6c163831297b0401dc08a5819651cafe7a95952d51472c224802918a08000f2eb800043928006f37c800079908006392b801cce3e804706b4800300228063ac918000381b80a13731800042e48005c0188000700b8019781e8026dfd5800197ee800107f58003afa78000451180003b7b8003adc2803d80b180081022800017568000a13d800e02408014345d8081cf54800358aa80005010800129b080343800800025d4800195a380004d6280002840809a5e3f80050b1d800242458000803f8000d0a880002db28017012380046ff180358a8680048939800ea84380006c9f800b8bef8001869980018650800186b4800186aa80013c688000e4e08003e9ac80035a70c8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}},{"result":{"type":"CALL","from":"0x854d6971733c84a8a62bab6f62a588a9e1e33f92","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x2d63e0","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010cc685f38c0eb557666ec57a72d13bffe796c8609bef895314803ed4c95de68bf7802917888000f2ea800043908006f3b5800079918006391e801cce8180470760800300268063ac198000381b80a1374d800042e48005c013800070098019783c8026dfbd800197f5800107ee8003afb28000451080003b7b8003adef803d82aa800810328000154c8000a13d800e01218014343b8081cd06800358a980005014800129b180343a3a800025d5800195a280004d6180002842809a5eab80050b2a8002424f800080408000d0de80002db4801700ec80046fe980358b3f80048933800ea81e80006ca0800b8be68001869980018639800186b4800186c680013c6a8000e4e18003e9bb80035a6bc8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}}]}
user@sgb-node % date ; curl -s -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"debug_traceBlockByNumber","params":["0x5a0d3a5", {"tracer": "callTracer"}],"id":1}' http://sgb01.node.local:9650/ext/C/rpc
Tue 17 Jun 2025 12:35:55 BST
{"jsonrpc":"2.0","id":1,"result":[{"result":{"type":"CALL","from":"0xb9f0f796bebca28c9813452c9b1b5719d89604e3","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x5237","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010ce0149d0628c389b6c163831297b0401dc08a5819651cafe7a95952d51472c224802918a08000f2eb800043928006f37c800079908006392b801cce3e804706b4800300228063ac918000381b80a13731800042e48005c0188000700b8019781e8026dfd5800197ee800107f58003afa78000451180003b7b8003adc2803d80b180081022800017568000a13d800e02408014345d8081cf54800358aa80005010800129b080343800800025d4800195a380004d6280002840809a5e3f80050b1d800242458000803f8000d0a880002db28017012380046ff180358a8680048939800ea84380006c9f800b8bef8001869980018650800186b4800186aa80013c688000e4e08003e9ac80035a70c8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}},{"result":{"type":"CALL","from":"0x854d6971733c84a8a62bab6f62a588a9e1e33f92","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x2d63e0","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010cc685f38c0eb557666ec57a72d13bffe796c8609bef895314803ed4c95de68bf7802917888000f2ea800043908006f3b5800079918006391e801cce8180470760800300268063ac198000381b80a1374d800042e48005c013800070098019783c8026dfbd800197f5800107ee8003afb28000451080003b7b8003adef803d82aa800810328000154c8000a13d800e01218014343b8081cd06800358a980005014800129b180343a3a800025d5800195a280004d6180002842809a5eab80050b2a8002424f800080408000d0de80002db4801700ec80046fe980358b3f80048933800ea81e80006ca0800b8be68001869980018639800186b4800186c680013c6a8000e4e18003e9bb80035a6bc8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}}]}
user@sgb-node % date ; curl -s -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"debug_traceBlockByNumber","params":["0x5a0d3a5", {"tracer": "callTracer"}],"id":1}' http://sgb01.node.local:9650/ext/C/rpc
Tue 17 Jun 2025 12:36:00 BST
{"jsonrpc":"2.0","id":1,"result":[{"result":{"type":"CALL","from":"0xb9f0f796bebca28c9813452c9b1b5719d89604e3","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x5237","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010ce0149d0628c389b6c163831297b0401dc08a5819651cafe7a95952d51472c224802918a08000f2eb800043928006f37c800079908006392b801cce3e804706b4800300228063ac918000381b80a13731800042e48005c0188000700b8019781e8026dfd5800197ee800107f58003afa78000451180003b7b8003adc2803d80b180081022800017568000a13d800e02408014345d8081cf54800358aa80005010800129b080343800800025d4800195a380004d6280002840809a5e3f80050b1d800242458000803f8000d0a880002db28017012380046ff180358a8680048939800ea84380006c9f800b8bef8001869980018650800186b4800186aa80013c688000e4e08003e9ac80035a70c8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}},{"result":{"type":"CALL","from":"0x854d6971733c84a8a62bab6f62a588a9e1e33f92","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x2d63e0","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010cc685f38c0eb557666ec57a72d13bffe796c8609bef895314803ed4c95de68bf7802917888000f2ea800043908006f3b5800079918006391e801cce8180470760800300268063ac198000381b80a1374d800042e48005c013800070098019783c8026dfbd800197f5800107ee8003afb28000451080003b7b8003adef803d82aa800810328000154c8000a13d800e01218014343b8081cd06800358a980005014800129b180343a3a800025d5800195a280004d6180002842809a5eab80050b2a8002424f800080408000d0de80002db4801700ec80046fe980358b3f80048933800ea81e80006ca0800b8be68001869980018639800186b4800186c680013c6a8000e4e18003e9bb80035a6bc8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}}]}
user@sgb-node % date ; curl -s -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"debug_traceBlockByNumber","params":["0x5a0d3a5", {"tracer": "callTracer"}],"id":1}' http://sgb01.node.local:9650/ext/C/rpc
Tue 17 Jun 2025 12:36:04 BST
{"jsonrpc":"2.0","id":1,"result":[{"result":{"type":"CALL","from":"0xb9f0f796bebca28c9813452c9b1b5719d89604e3","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x5237","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010ce0149d0628c389b6c163831297b0401dc08a5819651cafe7a95952d51472c224802918a08000f2eb800043928006f37c800079908006392b801cce3e804706b4800300228063ac918000381b80a13731800042e48005c0188000700b8019781e8026dfd5800197ee800107f58003afa78000451180003b7b8003adc2803d80b180081022800017568000a13d800e02408014345d8081cf54800358aa80005010800129b080343800800025d4800195a380004d6280002840809a5e3f80050b1d800242458000803f8000d0a880002db28017012380046ff180358a8680048939800ea84380006c9f800b8bef8001869980018650800186b4800186aa80013c688000e4e08003e9ac80035a70c8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}},{"result":{"type":"CALL","from":"0x854d6971733c84a8a62bab6f62a588a9e1e33f92","to":"0x2ca6571daa15ce734bbd0bf27d5c9d16787fc33f","value":"0x0","gas":"0x2d63e0","gasUsed":"0x15da","input":"0x9d00c9fd64000f8d57010cc685f38c0eb557666ec57a72d13bffe796c8609bef895314803ed4c95de68bf7802917888000f2ea800043908006f3b5800079918006391e801cce8180470760800300268063ac198000381b80a1374d800042e48005c013800070098019783c8026dfbd800197f5800107ee8003afb28000451080003b7b8003adef803d82aa800810328000154c8000a13d800e01218014343b8081cd06800358a980005014800129b180343a3a800025d5800195a280004d6180002842809a5eab80050b2a8002424f800080408000d0de80002db4801700ec80046fe980358b3f80048933800ea81e80006ca0800b8be68001869980018639800186b4800186c680013c6a8000e4e18003e9bb80035a6bc8000f8d57000300040f","output":"0x0000000000000000000000000000000000000000000000000000000000000001"}}]}
user@sgb-node % date ; curl -s -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"debug_traceBlockByNumber","params":["0x5a0d3a5", {"tracer": "callTracer"}],"id":1}' http://sgb01.node.local:9650/ext/C/rpc
Tue 17 Jun 2025 12:36:08 BST
{"jsonrpc":"2.0","id":1,"error":{"code":-32000,"message":"required historical state unavailable (reexec=128)"}}
user@sgb-nod % date ; curl -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":1}' https://songbird-api.flare.network/ext/C/rpc
Tue 17 Jun 2025 12:36:12 BST
{"jsonrpc":"2.0","id":1,"result":"0x5a0d3ce"}

Is this the expected behavior on the pruned node?