v1.6.0-rc2 - Lotus v1.20.0-rcX Compatibility

Overview

We're happy to announce the Boost v1.6.0-rc2 release.

This is a patch release to fix slow offline deal processing by Boost. You should upgrade to this release if you are currently running Boost v.1.6.0-rc1. See the Boost and Lotus compatibility matrix for up to date information, and to plan your upgrade.

Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

What's Changed

• feat: cache sealing pipeline status by @LexLuthr in #1209
• fix: BasicDealFilter logic by @LexLuthr in #1210
• fix: send more deal params to deal filters by @LexLuthr in #1213
• fix: bug bypassing basic filters by @LexLuthr in #1217

Full Changelog: v1.6.0-rc1...v1.6.0-rc2

v1.5.2

Overview

We're happy to announce the Boost v1.5.2 release.

This is a patch release to fix slow offline deal processing by Boost. You should upgrade to this release if you are currently running Boost v.1.5.1. See the Boost and Lotus compatibility matrix for up to date information, and to plan your upgrade.

Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

What's Changed

• fix: offline deal slow acceptance and ConsiderOnlineStorageDeals rejection by @LexLuthr in #1211
• fix: send more deal params to deal filters by @LexLuthr in #1213
• fix: basic deal filters no longer skipped #1218

Full Changelog: v1.5.1...v1.5.2

v1.6.0-rc1 - Lotus v1.20.0-rc1 Compatibility

Overview

We're happy to announce the Boost v1.6.0-rc1 release.

This is a compatibility update for the Lotus v1.20.0-rc1 release. You should only upgrade to this release if you are also upgrading Lotus to v1.20.0-rc1. See the Boost and Lotus compatibility matrix for up to date information, and to plan your upgrade.

Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

Boost v1.5.1 RC Adopters

If you have been running the v1.5.1 RC and want to update to this release for lotus compatibility, you can do so as long as you are also upgrading Lotus to v1.20.0-rc1. This PR contains the latest 1.5.1 codebase and we will continue to update it with any subsequent releases.

What's Changed

• Update support for lotus v1.20.0-rc1 by @jacobheun in #1188
• feat: add flags for bitswap server internals by @jacobheun in #1182
• Introduce deal proposal protocol v1.2.1 by @dirkmc in #1185
• Devnet images using Lotus from DockerHub by @airenas in #1157

Full Changelog: v1.5.1-rc5...v1.6.0-rc1

v1.5.1 - Bitswap support and more!

Overview

We're happy to announce the Boost v1.5.1 stable release, with several new features and fixes!
See our upgrade guide for details on upgrading.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

🌟 Highlights

Includes updates previously noted in RC builds of this release

IPFS retrieval support is here with Booster-bitswap!

• booster-bitswap is a binary that runs alongside the boostd process, to serve retrievals over the Bitswap protocol, which is the data transfer protocol used in IPFS. This release provides tools for managing a bitswap service for serving retrievals.
• Note that there is currently no payment method mechanism in booster-bitswap; this endpoint is intended to serve free content.
• Check out the docs on how to start serving Bitswap retrievals

Default Grafana dashboards and monitoring

• Boost now includes configured Grafana dashboards that SP's can enable with monitoring. See the monitoring tutorial in the docs for an example on how this is set up via docker. We plan to add more dashboards over time to improve visibility into the systems performance. Reach out in #boost-help on Slack if you have any questions!

Boostd process overview dashboard	Booster-bitswap retrieval dashboard

New storage deal proposal flags

• The new storage deal proposal flags adds configurability options to indexer announcements and storing unsealed copies of data. The current default storage deal protocol behaviors remain the same.
• Check out the details in the Propose Storage Deal Protocol docs

HTTP Retrieval Updates

• HTTP retrieval URLs have been redesigned to support piece retrievals for Spade (previously slingshot-evergreen).
  • We've simplified the /piece endpoint for ease of use, and optimized for existing user needs
  • BREAKING CHANGE: We removed support for getting the piece by its PayloadCid and the ability to retrieve the payload. We may revisit adding support back if there is clear demand.
• We've added a new /info endpoint that includes versioning of booster-http to make it easier to track changes
• You can see the updated endpoints in the docs - https://boost.filecoin.io/experimental-features/http-retrieval.

And more!

• You can now use the boost client to retrieve data similar to lotus' retrieve command, example:
  boost retrieve --provider=t01000 bafk2bzacedsnewk7clxwab2wgwyoi7u5tzdhldx7fkxpqdq7unrxz2zoy4d2g
• Boostx now includes a utility command for unsealing a sector, example:
  boostx sector unseal --api-fullnode=$FULLNODE_API_INFO --api-storage=$MINER_API_INFO 2

What's Changed

• Add wallet sign to boost cli by @jsmetana in #915
• add throttler to libp2p http server for estuary by @nonsense in #927
• Periodic logsDB cleanup based on configured duration by @LexLuthr in #929
• feat: add transparent gzip support for booster-http response by @LexLuthr in #932
• feat: retry offline deal after commp errors by @LexLuthr in #899
• feat: show datacap in boost wallet list by @LexLuthr in #959
• Add meaningful default for start-epoch by @parkan in #982
• feat: introduce http api version by @LexLuthr in #972
• Surface retrieval logs in Web UI by @dirkmc in #961
• Inspect by non-root cid by @dirkmc in #998
• feat: client flag to not announce deals by @LexLuthr in #1051
• Sort sealing worker list by date by @dirkmc in #1074
• Add bitswap bytes served grafana dashboard by @dirkmc in #1117
• add overview dashboard by @nonsense in #1122
• Add the ability to filter certain properties in the deal list by @jacobheun in #1097
• Add more storage deal filter parameters by @dirkmc in #497
• port boost retrieve to main branch by @dirkmc in #1163
• Port unseal command to main by @dirkmc in #1155
• feat: add flags for bitswap server internals by @jacobheun in #1182
• Introduce deal proposal protocol v1.2.1 by @dirkmc in #1185

New Contributors

• @jsmetana made their first contribution in #915
• @parkan made their first contribution in #982
• @ribasushi made their first contribution in #1152
• @ischasny made their first contribution in #1159

Full Changelog: v1.5.0...v1.5.1

v1.5.1-rc5

We're happy to announce the v1.5.1-rc5 release. This is the final planned RC before release.

Highlights

• Fixes an issue with booster-bitswap request caches not getting pruned. This should improve memory usage overtime. See #1167 for config options for managing the cache size and expiry time.
• Improves resiliency of deny filter downloads for booster-bitswap
• You can now use the boost client to retrieve data similar to lotus' retrieve command, example:
  boost retrieve --provider=t01000 bafk2bzacedsnewk7clxwab2wgwyoi7u5tzdhldx7fkxpqdq7unrxz2zoy4d2g
• Boostx now includes a utility command for unsealing a sector, example:
  boostx sector unseal --api-fullnode=$FULLNODE_API_INFO --api-storage=$MINER_API_INFO 2

What's Changed

• Add more storage deal filter parameters by @dirkmc in #497
• Fetch bitswap deny filters from remote if local cache is invalid by @ischasny in #1159
• port boost retrieve to RC by @dirkmc in #1163
• Port unseal command to RC @dirkmc in #1155
• feat: use an expiry lru cache for the index backed blockstore by @jacobheun in #1167

New Contributors

• @ribasushi made their first contribution in #1152
• @ischasny made their first contribution in #1159

Full Changelog: v1.5.1-rc4...v1.5.1-rc5

v1.5.1-rc4

What's Changed

• docs: clarify some language for running a docker devnet by @jacobheun in #1109
• lock docker tempo version by @dirkmc in #1113
• add 2 dashboards from main grafana instance by @nonsense in #1112
• fix: update deps to support node 16 and 18 by @jacobheun in #1114
• booster-bitswap init: output keyfile path by @dirkmc in #1116
• Adjust booster-bitswap verbosity by @dirkmc in #1110
• Add bitswap bytes served grafana dashboard by @dirkmc in #1117
• update tempo version by @dirkmc in #1118
• add commented-out extra_hosts field to docker-compose by @nonsense in #1120
• fix scrape target by @nonsense in #1121
• add overview metrics dashboard by @nonsense in #1122
• update metrics dashboards by @nonsense in #1123
• Add the ability to filter certain properties in the deal list by @jacobheun in #1097
• test: validate fix for failure to retrieve when root payload CID is an identity CID by @hannahhoward in #715
• fix: resolve dagstore crash with update to v0.5.7 by @dirkmc in #1136

Full Changelog: v1.5.1-rc3...v1.5.1-rc4

v1.5.1-rc3

Overview

We're happy to announce Boost v1.5.1-rc3 release.
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details. Remember to review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

Booster-bitswap is now available!

• booster-bitswap is a binary that runs alongside the boostd process, to serve retrievals over the Bitswap protocol, which is the data transfer protocol used in IPFS. This release provides tools for managing a bitswap service for serving retrievals.
• Note that there is currently no payment method mechanism in booster-bitswap; this endpoint is intended to serve free content.
• For storage providers that want to test out the new functionality, refer to #1036 and share your results and report any issues you have.

New storage deal proposal flags

• The new storage deal proposal flags adds configurability options to indexer announcements and storing unsealed copies of data. The current default storage deal protocol behaviors remain the same.
• SkipIPNIAnnounce: defaults to false. This flag enables storage clients to elect to not announce deal data to IPNI(InterPlanetary Network Indexer)
• RemoveUnsealedCopy: defaults to false. This flag enables storage clients to elect to not have an unsealed copy of their data stored

What's Changed

• fix: update to [email protected] by @rvagg in #1009
• need empty StoragePaths by @nonsense in #1012
• chore(deps): bump decode-uri-component from 0.2.0 to 0.2.2 in /react by @dependabot in #1034
• Update data-transfer v1.15.3 by @hannahhoward in #1056
• feat: client flag to not announce deals by @LexLuthr in #1051
• fix: vacuum db after log cleanup by @LexLuthr in #1059
• fix: run deal filter for offline deals by @LexLuthr in #1067
• fix deal status on transfer complete by @dirkmc in #1066
• Sort sealing worker list by date by @dirkmc in #1074
• chore(deps): bump json5 from 1.0.1 to 1.0.2 in /react by @dependabot in #1057
• Release: Booster bitswap by @hannahhoward in #1030
• add debug build params by @dirkmc in #1083
• docs: instruct devs to delete data folder for docker by @jacobheun in #1091
• Upgrade to the latest index provider with fixes to bitswap retrieval ads by @masih in #1090
• v1.5.1-rc3 by @dirkmc in #1094

Full Changelog: v1.5.1-rc2...v1.5.1-rc3

v1.5.1-rc2

Overview

❗Please make sure to upgrade to this release if you are running v1.5.1-rc1 to avoid Boost crashes:exclamation:
See our upgrade guide for details.
Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

• Fixed a panic that could sometimes occur in the new retrieval logger
• The inspect page can now be used on non root CIDs

What's Changed

• reduce noisy gql logs by @dirkmc in #997
• Inspect by non-root cid by @dirkmc in #998
• fix inspect page loading by @dirkmc in #1001
• fix: allow client to set fast-retrieval by @LexLuthr in #1004
• check for nil for evt.Response by @nonsense in #1007

Full Changelog: v1.5.1-rc1...v1.5.1-rc2

v1.5.1-rc1

Overview

We're happy to announce Boost v1.5.1-rc1 release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

HTTP Retrieval Updates

• HTTP retrieval URLs have been redesigned to support piece retrievals for Spade (previously slingshot-evergreen).
  • We've simplified the /piece endpoint for ease of use, and optimized for existing user needs
  • BREAKING CHANGE: We removed support for getting the piece by its PayloadCid and the ability to retrieve the payload. We may revisit adding support back if there is clear demand.
• We've added a new /info endpoint that includes versioning of booster-http to make it easier to track changes
• You can see the updated endpoints in the docs - https://boost.filecoin.io/experimental-features/http-retrieval.

Retrievals in the UI

• We've added a brand new Retrievals UI page which provides a 24 hour log of retrievals. This will enable SP's to have more visibility into retrieval failures, successes, and quick access to the retrieval logs.

And More!

• Docker devnet is now fully compatible with ARM based MacOS
• Lotus dependency updates to stable v1.18.0
• Configuration file has been upgraded to Version 4
• Boost client now lists fil-plus data cap in wallet list output
• The deal logs older than DealLogDurationDays set in config will be deleted from the logsDB to keep the size of the database in check
• Offline deal data import now support retry in case of commp mismatch or incorrect file path

Upcoming

• Work for new booster-bitswap binary is almost complete
• Metrics and stats collection is being integrated in Boost
• A new piece directory store to replace the existing dagstore is currently being tested

What's Changed

• chore: update go version for macos build by @LexLuthr in #911
• fix: use tagged go-car release instead of custom branch by @rvagg in #906
• feat: redesign http query url by @LexLuthr in #898
• Add wallet sign to boost cli by @jsmetana in #915
• add throttler to libp2p http server for estuary by @nonsense in #927
• Periodic logsDB cleanup based on configured duration by @LexLuthr in #929
• Fix log message in db cleanup by @dirkmc in #931
• feat: add transparent gzip support for booster-http response by @LexLuthr in #932
• feat: retry offline deal after commp errors by @LexLuthr in #899
• fix: wallet list output by @LexLuthr in #942
• update-version v1.5.0 by @LexLuthr in #957
• fix: http redirect for /piece/ in booster-http by @LexLuthr in #956
• feat: show datacap in boost wallet list by @LexLuthr in #959
• Add meaningful default for start-epoch by @parkan in #982
• Allow building docker from Mac M1 by @airenas in #979
• use forked go-jsonrpc by @nonsense in #971
• feat: introduce http api version by @LexLuthr in #972
• chore(deps): bump minimatch and recursive-readdir in /react by @dependabot in #985
• fix: deal filter description by @LexLuthr in #986
• Surface retrieval logs in Web UI by @dirkmc in #961
• chore(deps): bump loader-utils from 2.0.0 to 2.0.4 in /react by @dependabot in #955
• fix: update current http urls as per #960 by @LexLuthr in #975
• feat: migrate config to v4 by @LexLuthr in #992
• feat: upgrade lotus to v1.18.0 by @LexLuthr in #995

New Contributors

• @jsmetana made their first contribution in #915
• @parkan made their first contribution in #982

Full Changelog: v1.5.0...v1.5.1-rc1

v1.5.0

Overview

We're happy to announce Boost v1.5.0 stable release, with multiple changes and improvements!
This is a ❗MANDATORY❗ release of Boost to keep Boost compatible with Lotus v1.18.0 that introduces Network v17. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

• Docker devnet is now available for testing purpose.
• Missing market APIs MarketPendingDeals and SectorsRefs are now available in Boost to maintain backward compatibility
• Legacy deals can be searched via the UI
• Dependency upgrades for libp2p and go-fil-markets for compatibility with Lotus 1.18.0

Upcoming

• Work for new booster-bitswap binary is almost complete
• Metrics and stats collection is being integrated in Boost
• A new piece directory store to replace the existing dagstore is currently being tested

What's Changed

• Add booster-http pprof metrics to grafana dashboard by @kylehuntsman in #809
• bump lotus go.mod dep by @nonsense in #800
• Consolidate makefiles by @airenas in #785
• Add boostd pprof metrics to grafana dashboard by @kylehuntsman in #811
• Fix failing build for booster-http docker by @airenas in #815
• update readme for prometheus by @nonsense in #816
• initial boostd-data service by @nonsense in #821
• chore: update dagstore version by @LexLuthr in #823
• remove lotus-test in docker/build target requirements by @nonsense in #831
• Add http response code metrics to dashboard by @kylehuntsman in #827
• Register lotus dagstore metrics with prometheus exporter by @kylehuntsman in #828
• Add prometheus scrape config for lotus-miner by @kylehuntsman in #829
• check market protocol before making boost deal by @LexLuthr in #843
• Show legacy deals link at top of deals page by @dirkmc in #851
• add go-to link for pagination by @dirkmc in #852
• less frequent check for legacy deals count by @dirkmc in #854
• Search legacy deals by proposal cid by @dirkmc in #853
• add metrics-path by @nonsense in #850
• show minerID in protocol mismatch error by @LexLuthr in #857
• fix: add missing market APIs by @LexLuthr in #859
• release/lotus1.17.2 to main by @nonsense in #794
• bitswap client by @dirkmc in #856
• booster-bitswap output more logs with -vv flag by @dirkmc in #870
• Translate all not found errors to ipld ErrNotFound for bitswap by @dirkmc in #869
• bump lotus docker images to v1.17.2-rc2 by @nonsense in #868
• keep connection between booster-bitswap and proxy alive by @dirkmc in #867
• fix flaky TestMultipleDealsConcurrent by @dirkmc in #873
• Add booster-bitswap request and response count metrics to dashboard by @kylehuntsman in #838
• Configure docker volume for fil-proofs in .env by @airenas in #881
• deps: update to [email protected] by @rvagg in #887
• Announce Bitswap records to indexer by @hannahhoward in #839
• Add prometheus remote write configuration to PL Grafana by @kylehuntsman in #878
• Consolidate boost dockerfiles by @airenas in #872
• fix booster-bitswap init peer ID output by @dirkmc in #903
• Lotus Compatibility v1.18.0 update by @hannahhoward in #884

Full Changelog: v1.4.0...v1.5.0