v1.4.20

Added

• Added tools poll-rpc-blocks command to launch an RPC-based poller that acts as a firehose extractor node, printing base64-encoded protobuf blocks to stdout (used by the 'dev' node-type). It creates "light" blocks, without traces and ordinals.
• Added --dev flag to the start command to simplify running a local firehose+substreams stack from a development node (ex: Hardhat).
  • This flag overrides the --reader-node-path, instead pointing to the fireeth binary itself.
  • This flag overrides the --reader-node-type, setting it to dev instead of geth.
    This node type has the following default reader-node-arguments: tools poll-rpc-blocks http://localhost:8545 0
  • It also removes node from the list of default apps

Fixed

• Substreams: fixed metrics calculations (per-module processing-time and external calls were wrong)
• Substreams: fixed immediate EOF when streaming from block 0 to (unbounded) in dev mode

v1.4.19

• Bumped substreams to v1.1.18 with a regression fix for when a substreams has a start block in the reversible segment

v1.4.18

• Bumped substreams to v1.1.17 with fix missing decrement on metrics substreams_active_requests`

v1.4.17

Added

The --common-auth-plugin got back the ability to use secret://<expected_secret>?[user_id=<user_id>]&[api_key_id=<api_key_id>] in which case request are authenticated based on the Authorization: Bearer <actual_secret> and continue only if <actual_secret> == <expected_secret>.

Changed

• Bumped substreams to v1.1.16 with support of metrics substreams_active_requests and substreams_counter

v1.4.16

Operators of Polygon/Mumbai chains

• If you started reprocessing the blockchain blocks using release v1.4.14 or v1.4.15, you will need to run the following command to fix the blocks affected by another bug:
  fireeth tools fix-polygon-index /your/merged/blocks /temporary/destination 0 48200000 (note that you can run multiple instances of this command in parallel to cover the range of blocks from 0 to current HEAD in smaller chunks)

Fixed

• Fix another data issue found in polygon blocks: blocks that contain a single "system" transaction have "Index=1" for that transaction instead of "Index=0"

v1.4.15

Fixed

• (Substreams) fixed regressions for relative start-blocks for substreams (see https://github.com/streamingfast/substreams/releases/tag/v1.1.14)

v1.4.14

Operators

If you are indexing Polygon or Mumbai chains, you will need to reprocess the chain from genesis, as your existing Firehose blocks are missing some system transactions.

As always, this can be done with multiple client nodes working in parallel on different chain's segment if you have snapshots at various block heights.

Golang 1.21+ is now also required to build the project.

Fixed

• Fixed post-processing of polygon blocks: some system transactions were not "bundled" correctly.
• (Substreams) fixed validations for invalid start-blocks (see https://github.com/streamingfast/substreams/releases/tag/v1.1.13)

Added

• Added tools compare-oneblock-rpc command to perform a validation between a firehose 'one-block-file' blocks+trx+logs fetched from an RPC endpoint

Changed

• The tools print subcommands now use hex to encode values instead of base64, making them easier to use

v1.4.13

Important

The Substreams service exposed from this version will send progress messages that cannot be decoded by substreams clients prior to v1.1.12.
Streaming of the actual data will not be affected. Clients will need to be upgraded to properly decode the new progress messages.

Changed

• Bumped substreams to v1.1.12 to support the new progress message format. Progression now relates to stages instead of modules. You can get stage information using the substreams info command starting at version v1.1.12.

Added

• added tools compare-blocks-rpc command to perform a validation between firehose blocks and blocks+trx+logs fetched from an RPC endpoint

Fixed

• More tolerant retry/timeouts on filesource (prevent "Context Deadline Exceeded")

v1.4.12

Highlights

Operators

This release mainly brings reader-node Firehose Protocol 2.3 support for all networks and not just Polygon. This is important for the upcoming release of Firehose-enabled geth version 1.2.11 and 1.2.12 that are going to be releases shortly.

Golang 1.20+ is now also required to build the project.

Added

• Support reader node Firehose Protocol 2.3 on all networks now (and not just Polygon).

Fixed

• tools check merged-blocks now correctly prints missing block gaps even without print-full or print-stats.

Changed

• Now requires Go 1.20+ to compile the project.

v1.4.11

Fixes

• Bumped firehose and substreams library to fix a bug where live blocks were not metered correctly.