Releases: filecoin-project/boost
v1.5.0-rc1
Overview
We're happy to announce Boost v1.5.0-rc release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.
Please review the Boost and Lotus compatibility matrix to plan your upgrade.
Highlights
- Docker devnet is now available for testing purpose.
- Missing market APIs MarketPendingDeals and SectorsRefs are now available in Boost to maintain backward compatibility
- Legacy deals can be searched via the UI
- Dependency upgrades for libp2p and go-fil-markets
Upcoming
- Work for new booster-bitswap binary is almost complete
- Metrics and stats collection is being integrated in Boost
- A new
piece directory
store to replace the existing dagstore is currently being tested
What's Changed
- Add booster-http pprof metrics to grafana dashboard by @kylehuntsman in #809
- bump lotus go.mod dep by @nonsense in #800
- Consolidate makefiles by @airenas in #785
- Add boostd pprof metrics to grafana dashboard by @kylehuntsman in #811
- Fix failing build for booster-http docker by @airenas in #815
- update readme for prometheus by @nonsense in #816
- initial boostd-data service by @nonsense in #821
- chore: update dagstore version by @LexLuthr in #823
- remove lotus-test in docker/build target requirements by @nonsense in #831
- Add http response code metrics to dashboard by @kylehuntsman in #827
- Register lotus dagstore metrics with prometheus exporter by @kylehuntsman in #828
- Add prometheus scrape config for lotus-miner by @kylehuntsman in #829
- check market protocol before making boost deal by @LexLuthr in #843
- Show legacy deals link at top of deals page by @dirkmc in #851
- add go-to link for pagination by @dirkmc in #852
- less frequent check for legacy deals count by @dirkmc in #854
- Search legacy deals by proposal cid by @dirkmc in #853
- add metrics-path by @nonsense in #850
- show minerID in protocol mismatch error by @LexLuthr in #857
- fix: add missing market APIs by @LexLuthr in #859
- release/lotus1.17.2 to main by @nonsense in #794
- bitswap client by @dirkmc in #856
- booster-bitswap output more logs with -vv flag by @dirkmc in #870
- Translate all not found errors to ipld ErrNotFound for bitswap by @dirkmc in #869
- bump lotus docker images to v1.17.2-rc2 by @nonsense in #868
- keep connection between booster-bitswap and proxy alive by @dirkmc in #867
- fix flaky TestMultipleDealsConcurrent by @dirkmc in #873
- Add booster-bitswap request and response count metrics to dashboard by @kylehuntsman in #838
- Configure docker volume for fil-proofs in .env by @airenas in #881
- deps: update to [email protected] by @rvagg in #887
- Announce Bitswap records to indexer by @hannahhoward in #839
- Add prometheus remote write configuration to PL Grafana by @kylehuntsman in #878
- Consolidate boost dockerfiles by @airenas in #872
- fix booster-bitswap init peer ID output by @dirkmc in #903
- Lotus Compatibility v1.18.0 update by @hannahhoward in #884
Full Changelog: v1.4.0...v1.5.0-rc1
v1.4.0
Overview
We're happy to announce Boost v1.4.0 release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.
Please review the Boost and Lotus compatibility matrix to plan your upgrade.
Highlights
Remote commP calculation
HTTP Retrievals
- Boost HTTP endpoint can now be discovered publicly via the
boost
client. - SP's can set their HTTP url that will be shared as part of this new libp2p endpoint
HTTP online deals
- Boost can now limit the number of simultaneous HTTP connections when downloading the deal data. Check all about the HTTP limiter here. This applies to both libp2p-http (Estuary) and HTTP (Bidbot and boost client) storage deals.
- The UI Transfer page now displays all the ongoing HTTP connections and their transfer speed.
- A new config version is available with new HTTP rate limiting parameters
- The amount of space that can be reserved for downloaded data per-host is now configurable. This helps mitigate against a single host with a slow connection reserving all the download space, when there may be other hosts with faster connections that have not had a chance to propose a deal yet
General
- Dagstore can be queried to find the piece CID for a given payload CID
boostd dagstore lookup-piece-cid --help
- Boost client will now return the sector state from sealing pipeline instead of just "sealing" when querying the deal status
- Boost will now allow using a single wallet for deal collaterals as well as deal message publishing
What's Changed
- When migrating from lotus start from default config by @dirkmc in #702
- publish message menu bar-chart by @dirkmc in #703
- deal publishing / fees: remove redundant configs by @nonsense in #687
- send sealing status in deal status response by @dirkmc in #704
- Calculate commp on sealing node by @dirkmc in #541
- v1.4.0-rc1 release by @LexLuthr in #719
- booster-http: don't extract contents of CAR file for HEAD requests by @dirkmc in #718
- libp2p retrieval transports endpoint by @dirkmc in #723
- booster-http: disable on-the-fly indexing by default by @dirkmc in #646
- set booster-http cache control headers by @dirkmc in #724
- Fix Content-Length header in HEAD request for CAR file by @dirkmc in #725
- Rename booster-http flag --api-sealer to --api-storage by @dirkmc in #734
- Update config version to 3 by @LexLuthr in #735
- Transfer limiter by @dirkmc in #710
- Docker files by @airenas in #713
- fix: dagstore destroy-shard by @LexLuthr in #744
- consolidate markdown documentation by @nonsense in #743
- change network name for devnet by @nonsense in #747
- Transfer limiter web UI updates by @dirkmc in #740
- feat: dagstore lookup-cid command by @LexLuthr in #751
- bump version for v1.4.0-rc2 by @LexLuthr in #755
- chore: fix version-check.sh perms by @LexLuthr in #758
- monitoring docker stack by @nonsense in #760
- Throttle local commp by @dirkmc in #763
- FIx dockerfile for building react by @airenas in #764
- tracing for boost and booster-http by @nonsense in #738
- Allow Boost RPC API to capture parent trace contexts by @kylehuntsman in #771
- Add --enable-tracing flag to booster-http by @kylehuntsman in #776
- Output sealing state changes to the deal log by @dirkmc in #775
- Fail the deal if the transfer fails by @dirkmc in #777
- tracing behind feature-flag for boostd; configuration in config.toml by @nonsense in #778
- Docker boost speedup by @airenas in #770
- Configurable download limit per host by @dirkmc in #780
- fix log line by @nonsense in #783
- README: fix port for gui by @nonsense in #789
- Remove single wallet restriction by @LexLuthr in #792
- Speed up tests with transfers by @dirkmc in #799
- Set up initial infrastructure for Grafana metrics capture with docker monitoring stack by @kylehuntsman in #797
- Add react GUI to boost docker by @airenas in #793
- feat: add json output to
boostd pieces
command by @LexLuthr in #806 - bump version to v1.4.0 by @LexLuthr in #808
New Contributors
- @airenas made their first contribution in #713
- @kylehuntsman made their first contribution in #771
Full Changelog: v1.3.1...v1.4.0
v1.4.0-rc2
Overview
We're happy to announce Boost v1.4.0-rc2 release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.
Please review the Boost and Lotus compatibility matrix to plan your upgrade.
Highlights
- Boost HTTP endpoint can now be discovered publicly via the
boost
client.- SP's can set their HTTP url that will be shared as part of this new libp2p endpoint
- Boost can now limit the number of simultaneous HTTP connections when downloading the deal data. Check all about the HTTP limiter here. This applies to both libp2p-http (Estuary) and HTTP (Bidbot and boost client) storage deals.
- The UI Transfer page now displays all the ongoing HTTP connections and their transfer speed.
- Dagstore can be queried to find the piece CID for a given payload CID
boostd dagstore lookup-piece-cid --help
- A new config version is available with new HTTP rate limiting parameters
What's Changed
- booster-http: don't extract contents of CAR file for HEAD requests by @dirkmc in #718
- libp2p retrieval transports endpoint by @dirkmc in #723
- booster-http: disable on-the-fly indexing by default by @dirkmc in #646
- set booster-http cache control headers by @dirkmc in #724
- Fix Content-Length header in HEAD request for CAR file by @dirkmc in #725
- Rename booster-http flag --api-sealer to --api-storage by @dirkmc in #734
- Update config version to 3 by @LexLuthr in #735
- Transfer limiter by @dirkmc in #710
- Docker files by @airenas in #713
- fix: dagstore destroy-shard by @LexLuthr in #744
- consolidate markdown documentation by @nonsense in #743
- change network name for devnet by @nonsense in #747
- Transfer limiter web UI updates by @dirkmc in #740
- feat: dagstore lookup-cid command by @LexLuthr in #751
- bump version for v1.4.0-rc2 by @LexLuthr in #755
New Contributors
Full Changelog: v1.4.0-rc1...v1.4.0-rc2
v1.4.0-rc1
Overview
We're happy to announce Boost v1.4.0-rc1 release, with multiple changes and improvements!
Highlights
- The commP calculation can now be delegated to the AP nodes in the sealing pipeline.
- Boost client will now return the sector state from sealing pipeline instead of just "sealing" when querying the deal status
What's Changed
- When migrating from lotus start from default config by @dirkmc in #702
- publish message menu bar-chart by @dirkmc in #703
- deal publishing / fees: remove redundant configs by @nonsense in #687
- send sealing status in deal status response by @dirkmc in #704
- Calculate commp on sealing node by @dirkmc in #541
- v1.4.0-rc1 release by @LexLuthr in #719
Full Changelog: v1.3.1...v1.4.0-rc1
v1.3.1
Overview
We're happy to announce Boost v1.3.1 release, with multiple changes and improvements!
This release includes important fixes, some of which may be critical for security. Unless the fix addresses a bug being exploited in the wild, the fix will not be called out in the release notes.
Highlights
- Fix for 'database is locked error'
- Fix for crash in boost client
deal status
command
What's Changed
- chore: update xcode version to supported by @LexLuthr in #694
- Fix 'database is locked' error by @nonsense in #679
- fix nil ptr in deal status command by @nonsense in #685
- chore: add dependabot.yml file by @jacobheun in #653
- chore(deps): bump terser from 5.13.1 to 5.14.2 in /react by @dependabot in #658
- fix settings page file size preview by @dirkmc in #701
Full Changelog: v1.3.0...v1.3.1
v1.3.0
Overview
We're happy to announce Boost v1.3.0 release, with multiple changes and improvements!
This release includes important fixes, some of which may be critical for security. Unless the fix addresses a bug being exploited in the wild, the fix will not be called out in the release notes.
Please make sure to update ASAP. See our upgrade guide for details.
Highlights
- Full compatibility with the latest Lotus v1.17.0 stable release
- A new dagstore destroy-shard command to help remove incorrectly added shards
boostd dagstore destroy-shard --help
- Fix for commP mismatch in Boost libraries used by Estuary
What's Changed
- Include indicator of indexer in stats by @willscott in #661
- add power to boostx stats by @nonsense in #638
- chore: fix build macos by @LexLuthr in #662
- update readme to refer to docs by @LaurenSpiegel in #663
- Upgrade lotus dependency to v1.17.0-rc3 by @LexLuthr in #672
- fix: don't allow go-merkledag to reorder loaded links by @rvagg in #675
- remove fil from gas limit by @nonsense in #684
- feat: DagstoreDestroyShard API and CLI by @LexLuthr in #681
- Release V1.3.0 by @LexLuthr in #692
New Contributors
- @willscott made their first contribution in #661
- @LaurenSpiegel made their first contribution in #663
Full Changelog: v1.2.0...v1.3.0
v1.3.0-rc1
Overview
We're happy to announce Boost v1.3.0-rc1 release compatible with Lotus v1.17.0-rc3 and later.
Please make sure to update ASAP if you are using Lotus v1.17.0-rc3. See our upgrade guide for details.
Boost and Lotus compatibility matrix is available in the documents.
What's Changed
New Contributors
Full Changelog: v1.2.0...v1.3.0-rc1
v1.2.0
Overview
We're happy to announce Boost v1.2.0 release, with multiple changes and improvements!
This release includes important fixes, some of which may be critical for security. Unless the fix addresses a bug being exploited in the wild, the fix will not be called out in the release notes.
Please make sure to update ASAP. See our upgrade guide for details.
Highlights
- A brand new
booster-http
binary to serve retrievals over http (experimental) - The documentation will include a dedicated experimental features section detailing new features for testing as soon as they are ready
- Full compatibility with Lotus v1.16.x and v1.17.x
- A new boost inspect page in the UI to help debug problems with retrievals and keeping track of unsealed pieces
- Boost can now be built for calibration network.
⚠️ The naming convention of actors will still be displayed starting with "f" instead of "t"- git clone https://github.com/filecoin-project/boost.git
- git checkout v1.2.0
- make calibnet
- Complete integration of libp2p manager
boostd net --help
What's Changed
- use BigInt for get ask and set ask by @dirkmc in #612
- fix data rate in menu by @nonsense in #618
- add net commands by @LexLuthr in #614
- add configuration for graphql server port by @dirkmc in #620
- update calibnet build to include react by @LexLuthr in #624
- Update version to v1.1.0 on main branch by @dirkmc in #626
- boostx stats command by @nonsense in #627
- update backup command to include new config directory by @LexLuthr in #625
- Upgrade to the head of lotus 1.17.0 with dependency updates by @masih in #628
- Add BOOST_REPO env var by @f8-ptrk in #629
- make --repo flag global by @nonsense in #630
- update to go-fil-markets v1.23.0 by @dirkmc in #634
- update binary version to v1.1.1 by @dirkmc in #637
- boostd inspect command by @nonsense in #636
- release: v1.2.0-rc1 by @dirkmc in #639
- http retrieve entire piece (not just CAR file) by @dirkmc in #640
- Upgrade to latest
go-car
rebase of offset writer by @masih in #641 - upgrade go-car/v2 by @nonsense in #643
- Bump version in preparation to release
1.2.0-rc2
by @masih in #644 - chore(deps): bump moment from 2.29.2 to 2.29.4 in /react by @dependabot in #642
- fix: array out of bounds by @dirkmc in #648
- bump verion to v1.2.0-rc3 by @LexLuthr in #649
- Feat/v1.2.0 by @LexLuthr in #651
New Contributors
Full Changelog: v1.1.1...v1.2.0
v1.2.0-rc3
What's Changed
- chore(deps): bump moment from 2.29.2 to 2.29.4 in /react by @dependabot in #642
- fix: array out of bounds by @dirkmc in #648
- bump verion to v1.2.0-rc3 by @LexLuthr in #649
Full Changelog: v1.2.0-rc2...v1.2.0-rc3
v1.2.0-rc2
What's Changed
- http retrieve entire piece (not just CAR file) by @dirkmc in #640
- Upgrade to latest
go-car
rebase of offset writer by @masih in #641 - upgrade go-car/v2 by @nonsense in #643
- Bump version in preparation to release
1.2.0-rc2
by @masih in #644
Booster-HTTP
To build and run booster-http:
$ make booster-http
$ boostd auth api-info --perm=admin
$ export BOOST_API_INFO=<connect string>
$ booster-http run --api-boost=$BOOST_API_INFO --api-fullnode=$FULLNODE_API_INFO --api-sealer=$MINER_API_INFO
To download:
# Download piece by piece CID
curl http://localhost:7777/piece/<piece cid> > /tmp/download.piece
# Download CAR by piece CID
curl http://localhost:7777/piece/<piece cid>.car > /tmp/download.car
# Download piece by payload CID (piece must be indexed)
curl http://localhost:7777/payload/<payload cid> > /tmp/download.piece
# Download CAR by payload CID
curl http://localhost:7777/payload/<payload cid>.car > /tmp/download.car
Full Changelog: v1.2.0-rc1...v1.2.0-rc2