feat(verification): Changes to Support 0.69.0 CN Protobuf and Produced blocks

[AlfredoG87]

Reviewer Notes

• Now CN version for downloading API Protobuf definition supports Tag name, and not only commit hash.
• Necessary changes to support HAPI 0.69.0 version of protobuf
• For StreamingHasher: removed masking of NoSuchAlgorithmException under a RuntimeException, since is on the construction, it should fail under the right exception at the class that is instantiating it, and either force recovery or fail, leaving this decision to the instantiating class.
• Improving BlockProof Selection condition to only use Tss Based proof by checking hasSignedBlockProof and verifying there is a single one.
• Changed the Simulator to always produce deterministic blocks, so the rootHashOfAllBlockHashesTree always matches between runs, this is needed for E2E Testing scenarios.
• S3ArchivePluginTest: Improved Flaky test by giving a tiny bit more time.
• VerificationSession interface now has 2 methods, a void processBlockItems and a finalizeVerification that returns the VerificationNotification result, making use of the end_of_block message that is now received and not relaying on block_proofs alone. This achieves division of processing and hashing block_items, and requesting a block_proof verification.
• Verification plugin now calculates the root of all previous block hashes when starting from genesis, loads and writes them to disk so full history node can recover fast from restart, and provides previousBlockHash and rootHashOfAllPreviousBlocks when available and enabled. Otherwise (when not available) Verification will rely on the information provided by the BlockFooter as true.
• Added UTs for AllBlocksHahserHandler

Related Issue(s)

#1906

[jsync-swirlds]

Still working through this, but there are a few comments below to start with.

[jsync-swirlds]

A few small items and an API design concern.

[codecov]

Codecov Report

❌ Patch coverage is 87.41007% with 35 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
...lock/node/verification/AllBlocksHasherHandler.java	89.36%	10 Missing and 5 partials ⚠️
...k/node/verification/VerificationServicePlugin.java	76.66%	4 Missing and 3 partials ⚠️
...cation/session/impl/ExtendedMerkleTreeSession.java	71.42%	3 Missing and 3 partials ⚠️
...k/simulator/generator/CraftBlockStreamManager.java	87.23%	6 Missing ⚠️
...ication/session/impl/DummyVerificationSession.java	83.33%	0 Missing and 1 partial ⚠️

@@             Coverage Diff              @@
##               main    #1993      +/-   ##
============================================
+ Coverage     78.99%   79.76%   +0.76%     
- Complexity     1241     1296      +55     
============================================
  Files           130      131       +1     
  Lines          5952     6168     +216     
  Branches        646      664      +18     
============================================
+ Hits           4702     4920     +218     
+ Misses          955      945      -10     
- Partials        295      303       +8     

Files with missing lines	Coverage Δ	Complexity Δ
...ro/block/node/verification/VerificationConfig.java	100.00% <100.00%> (ø)	1.00 <1.00> (ø)
...erification/session/HapiVersionSessionFactory.java	91.30% <100.00%> (+8.69%)	10.00 <1.00> (+1.00)
...rg/hiero/block/common/hasher/HashingUtilities.java	80.58% <100.00%> (+0.77%)	15.00 <1.00> (ø)
...org/hiero/block/common/hasher/StreamingHasher.java	100.00% <100.00%> (+100.00%)	11.00 <0.00> (+11.00)
...enerator/itemhandler/AbstractBlockItemHandler.java	83.33% <100.00%> (ø)	6.00 <3.00> (ø)
...ator/generator/itemhandler/BlockFooterHandler.java	100.00% <100.00%> (ø)	5.00 <2.00> (+1.00)
...ator/generator/itemhandler/EventHeaderHandler.java	100.00% <100.00%> (ø)	5.00 <0.00> (ø)
...enerator/itemhandler/TransactionResultHandler.java	100.00% <100.00%> (ø)	7.00 <2.00> (ø)
...ication/session/impl/DummyVerificationSession.java	88.88% <83.33%> (+2.22%)	2.00 <1.00> (ø)
...cation/session/impl/ExtendedMerkleTreeSession.java	84.48% <71.42%> (-0.30%)	16.00 <12.00> (+3.00)	⬇️
... and 3 more

... and 1 file with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[jsync-swirlds]

We could just collapse this to one line; it's a little long, but not so long that it's a problem (in my opinion).
Not strictly necessary, however.

[jsync-swirlds]

nitpick: this. is not necessary here.
More significantly, we should detect if blockFooter is null immediately prior to this line and fail the verification rather than throwing a NPE or continuing the process.

[jsync-swirlds]

Kind of expensive (particularly for large blocks).
Might be better (particularly as it's only used for block proof) to just take the last item, and if it's not the expected type return null.
For the short term (until we support multiple block proofs, which has to come fairly quickly, possibly as soon as next sprint) that should be sufficient.

[jsync-swirlds]

Why the new Object[] here?

Suggested change

	LOGGER.log(TRACE, "Persisting all blocks hasher with {0} leaves snapshot to {1}", new Object[] {
	hasher.leafCount(), hasherFilePath
	});
	LOGGER.log(TRACE, "Persisting all blocks hasher with {0} leaves snapshot to {1}", hasher.leafCount(), hasherFilePath);

[jsync-swirlds]

This performs a string catenation every time it's called.
we should replace this with a constant to avoid that.

Suggested change

	"Cannot rebuild hasher from store: requires a single contiguous range starting from genesis. "
	+ "Found {0} range(s) starting at block {1}. Will fall back to block footer values.",
	private final static String HASHER_REQUIRES_CONTINUOUS_RANGE_MESSAGE =
	"Cannot rebuild hasher from store: requires a single contiguous range starting from genesis. "
	+ "Found {0} range(s) starting at block {1}. Will fall back to block footer values.";

[jsync-swirlds]

Just a couple items to clean up.
Could be done in a follow-up if desired.