v1.5.1-rc4

What's Changed

• docs: clarify some language for running a docker devnet by @jacobheun in #1109
• lock docker tempo version by @dirkmc in #1113
• add 2 dashboards from main grafana instance by @nonsense in #1112
• fix: update deps to support node 16 and 18 by @jacobheun in #1114
• booster-bitswap init: output keyfile path by @dirkmc in #1116
• Adjust booster-bitswap verbosity by @dirkmc in #1110
• Add bitswap bytes served grafana dashboard by @dirkmc in #1117
• update tempo version by @dirkmc in #1118
• add commented-out extra_hosts field to docker-compose by @nonsense in #1120
• fix scrape target by @nonsense in #1121
• add overview metrics dashboard by @nonsense in #1122
• update metrics dashboards by @nonsense in #1123
• Add the ability to filter certain properties in the deal list by @jacobheun in #1097
• test: validate fix for failure to retrieve when root payload CID is an identity CID by @hannahhoward in #715
• fix: resolve dagstore crash with update to v0.5.7 by @dirkmc in #1136

Full Changelog: v1.5.1-rc3...v1.5.1-rc4

v1.5.1-rc3

Overview

We're happy to announce Boost v1.5.1-rc3 release.
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details. Remember to review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

Booster-bitswap is now available!

• booster-bitswap is a binary that runs alongside the boostd process, to serve retrievals over the Bitswap protocol, which is the data transfer protocol used in IPFS. This release provides tools for managing a bitswap service for serving retrievals.
• Note that there is currently no payment method mechanism in booster-bitswap; this endpoint is intended to serve free content.
• For storage providers that want to test out the new functionality, refer to #1036 and share your results and report any issues you have.

New storage deal proposal flags

• The new storage deal proposal flags adds configurability options to indexer announcements and storing unsealed copies of data. The current default storage deal protocol behaviors remain the same.
• SkipIPNIAnnounce: defaults to false. This flag enables storage clients to elect to not announce deal data to IPNI(InterPlanetary Network Indexer)
• RemoveUnsealedCopy: defaults to false. This flag enables storage clients to elect to not have an unsealed copy of their data stored

What's Changed

• fix: update to [email protected] by @rvagg in #1009
• need empty StoragePaths by @nonsense in #1012
• chore(deps): bump decode-uri-component from 0.2.0 to 0.2.2 in /react by @dependabot in #1034
• Update data-transfer v1.15.3 by @hannahhoward in #1056
• feat: client flag to not announce deals by @LexLuthr in #1051
• fix: vacuum db after log cleanup by @LexLuthr in #1059
• fix: run deal filter for offline deals by @LexLuthr in #1067
• fix deal status on transfer complete by @dirkmc in #1066
• Sort sealing worker list by date by @dirkmc in #1074
• chore(deps): bump json5 from 1.0.1 to 1.0.2 in /react by @dependabot in #1057
• Release: Booster bitswap by @hannahhoward in #1030
• add debug build params by @dirkmc in #1083
• docs: instruct devs to delete data folder for docker by @jacobheun in #1091
• Upgrade to the latest index provider with fixes to bitswap retrieval ads by @masih in #1090
• v1.5.1-rc3 by @dirkmc in #1094

Full Changelog: v1.5.1-rc2...v1.5.1-rc3

v1.5.1-rc2

Overview

❗Please make sure to upgrade to this release if you are running v1.5.1-rc1 to avoid Boost crashes:exclamation:
See our upgrade guide for details.
Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

• Fixed a panic that could sometimes occur in the new retrieval logger
• The inspect page can now be used on non root CIDs

What's Changed

• reduce noisy gql logs by @dirkmc in #997
• Inspect by non-root cid by @dirkmc in #998
• fix inspect page loading by @dirkmc in #1001
• fix: allow client to set fast-retrieval by @LexLuthr in #1004
• check for nil for evt.Response by @nonsense in #1007

Full Changelog: v1.5.1-rc1...v1.5.1-rc2

v1.5.1-rc1

Overview

We're happy to announce Boost v1.5.1-rc1 release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

HTTP Retrieval Updates

• HTTP retrieval URLs have been redesigned to support piece retrievals for Spade (previously slingshot-evergreen).
  • We've simplified the /piece endpoint for ease of use, and optimized for existing user needs
  • BREAKING CHANGE: We removed support for getting the piece by its PayloadCid and the ability to retrieve the payload. We may revisit adding support back if there is clear demand.
• We've added a new /info endpoint that includes versioning of booster-http to make it easier to track changes
• You can see the updated endpoints in the docs - https://boost.filecoin.io/experimental-features/http-retrieval.

Retrievals in the UI

• We've added a brand new Retrievals UI page which provides a 24 hour log of retrievals. This will enable SP's to have more visibility into retrieval failures, successes, and quick access to the retrieval logs.

And More!

• Docker devnet is now fully compatible with ARM based MacOS
• Lotus dependency updates to stable v1.18.0
• Configuration file has been upgraded to Version 4
• Boost client now lists fil-plus data cap in wallet list output
• The deal logs older than DealLogDurationDays set in config will be deleted from the logsDB to keep the size of the database in check
• Offline deal data import now support retry in case of commp mismatch or incorrect file path

Upcoming

• Work for new booster-bitswap binary is almost complete
• Metrics and stats collection is being integrated in Boost
• A new piece directory store to replace the existing dagstore is currently being tested

What's Changed

• chore: update go version for macos build by @LexLuthr in #911
• fix: use tagged go-car release instead of custom branch by @rvagg in #906
• feat: redesign http query url by @LexLuthr in #898
• Add wallet sign to boost cli by @jsmetana in #915
• add throttler to libp2p http server for estuary by @nonsense in #927
• Periodic logsDB cleanup based on configured duration by @LexLuthr in #929
• Fix log message in db cleanup by @dirkmc in #931
• feat: add transparent gzip support for booster-http response by @LexLuthr in #932
• feat: retry offline deal after commp errors by @LexLuthr in #899
• fix: wallet list output by @LexLuthr in #942
• update-version v1.5.0 by @LexLuthr in #957
• fix: http redirect for /piece/ in booster-http by @LexLuthr in #956
• feat: show datacap in boost wallet list by @LexLuthr in #959
• Add meaningful default for start-epoch by @parkan in #982
• Allow building docker from Mac M1 by @airenas in #979
• use forked go-jsonrpc by @nonsense in #971
• feat: introduce http api version by @LexLuthr in #972
• chore(deps): bump minimatch and recursive-readdir in /react by @dependabot in #985
• fix: deal filter description by @LexLuthr in #986
• Surface retrieval logs in Web UI by @dirkmc in #961
• chore(deps): bump loader-utils from 2.0.0 to 2.0.4 in /react by @dependabot in #955
• fix: update current http urls as per #960 by @LexLuthr in #975
• feat: migrate config to v4 by @LexLuthr in #992
• feat: upgrade lotus to v1.18.0 by @LexLuthr in #995

New Contributors

• @jsmetana made their first contribution in #915
• @parkan made their first contribution in #982

Full Changelog: v1.5.0...v1.5.1-rc1

v1.5.0

Overview

We're happy to announce Boost v1.5.0 stable release, with multiple changes and improvements!
This is a ❗MANDATORY❗ release of Boost to keep Boost compatible with Lotus v1.18.0 that introduces Network v17. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

• Docker devnet is now available for testing purpose.
• Missing market APIs MarketPendingDeals and SectorsRefs are now available in Boost to maintain backward compatibility
• Legacy deals can be searched via the UI
• Dependency upgrades for libp2p and go-fil-markets for compatibility with Lotus 1.18.0

Upcoming

• Work for new booster-bitswap binary is almost complete
• Metrics and stats collection is being integrated in Boost
• A new piece directory store to replace the existing dagstore is currently being tested

What's Changed

• Add booster-http pprof metrics to grafana dashboard by @kylehuntsman in #809
• bump lotus go.mod dep by @nonsense in #800
• Consolidate makefiles by @airenas in #785
• Add boostd pprof metrics to grafana dashboard by @kylehuntsman in #811
• Fix failing build for booster-http docker by @airenas in #815
• update readme for prometheus by @nonsense in #816
• initial boostd-data service by @nonsense in #821
• chore: update dagstore version by @LexLuthr in #823
• remove lotus-test in docker/build target requirements by @nonsense in #831
• Add http response code metrics to dashboard by @kylehuntsman in #827
• Register lotus dagstore metrics with prometheus exporter by @kylehuntsman in #828
• Add prometheus scrape config for lotus-miner by @kylehuntsman in #829
• check market protocol before making boost deal by @LexLuthr in #843
• Show legacy deals link at top of deals page by @dirkmc in #851
• add go-to link for pagination by @dirkmc in #852
• less frequent check for legacy deals count by @dirkmc in #854
• Search legacy deals by proposal cid by @dirkmc in #853
• add metrics-path by @nonsense in #850
• show minerID in protocol mismatch error by @LexLuthr in #857
• fix: add missing market APIs by @LexLuthr in #859
• release/lotus1.17.2 to main by @nonsense in #794
• bitswap client by @dirkmc in #856
• booster-bitswap output more logs with -vv flag by @dirkmc in #870
• Translate all not found errors to ipld ErrNotFound for bitswap by @dirkmc in #869
• bump lotus docker images to v1.17.2-rc2 by @nonsense in #868
• keep connection between booster-bitswap and proxy alive by @dirkmc in #867
• fix flaky TestMultipleDealsConcurrent by @dirkmc in #873
• Add booster-bitswap request and response count metrics to dashboard by @kylehuntsman in #838
• Configure docker volume for fil-proofs in .env by @airenas in #881
• deps: update to [email protected] by @rvagg in #887
• Announce Bitswap records to indexer by @hannahhoward in #839
• Add prometheus remote write configuration to PL Grafana by @kylehuntsman in #878
• Consolidate boost dockerfiles by @airenas in #872
• fix booster-bitswap init peer ID output by @dirkmc in #903
• Lotus Compatibility v1.18.0 update by @hannahhoward in #884

Full Changelog: v1.4.0...v1.5.0

v1.5.0-rc1

Overview

We're happy to announce Boost v1.5.0-rc release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

• Docker devnet is now available for testing purpose.
• Missing market APIs MarketPendingDeals and SectorsRefs are now available in Boost to maintain backward compatibility
• Legacy deals can be searched via the UI
• Dependency upgrades for libp2p and go-fil-markets

Upcoming

• Work for new booster-bitswap binary is almost complete
• Metrics and stats collection is being integrated in Boost
• A new piece directory store to replace the existing dagstore is currently being tested

What's Changed

• Add booster-http pprof metrics to grafana dashboard by @kylehuntsman in #809
• bump lotus go.mod dep by @nonsense in #800
• Consolidate makefiles by @airenas in #785
• Add boostd pprof metrics to grafana dashboard by @kylehuntsman in #811
• Fix failing build for booster-http docker by @airenas in #815
• update readme for prometheus by @nonsense in #816
• initial boostd-data service by @nonsense in #821
• chore: update dagstore version by @LexLuthr in #823
• remove lotus-test in docker/build target requirements by @nonsense in #831
• Add http response code metrics to dashboard by @kylehuntsman in #827
• Register lotus dagstore metrics with prometheus exporter by @kylehuntsman in #828
• Add prometheus scrape config for lotus-miner by @kylehuntsman in #829
• check market protocol before making boost deal by @LexLuthr in #843
• Show legacy deals link at top of deals page by @dirkmc in #851
• add go-to link for pagination by @dirkmc in #852
• less frequent check for legacy deals count by @dirkmc in #854
• Search legacy deals by proposal cid by @dirkmc in #853
• add metrics-path by @nonsense in #850
• show minerID in protocol mismatch error by @LexLuthr in #857
• fix: add missing market APIs by @LexLuthr in #859
• release/lotus1.17.2 to main by @nonsense in #794
• bitswap client by @dirkmc in #856
• booster-bitswap output more logs with -vv flag by @dirkmc in #870
• Translate all not found errors to ipld ErrNotFound for bitswap by @dirkmc in #869
• bump lotus docker images to v1.17.2-rc2 by @nonsense in #868
• keep connection between booster-bitswap and proxy alive by @dirkmc in #867
• fix flaky TestMultipleDealsConcurrent by @dirkmc in #873
• Add booster-bitswap request and response count metrics to dashboard by @kylehuntsman in #838
• Configure docker volume for fil-proofs in .env by @airenas in #881
• deps: update to [email protected] by @rvagg in #887
• Announce Bitswap records to indexer by @hannahhoward in #839
• Add prometheus remote write configuration to PL Grafana by @kylehuntsman in #878
• Consolidate boost dockerfiles by @airenas in #872
• fix booster-bitswap init peer ID output by @dirkmc in #903
• Lotus Compatibility v1.18.0 update by @hannahhoward in #884

Full Changelog: v1.4.0...v1.5.0-rc1

v1.4.0

Overview

We're happy to announce Boost v1.4.0 release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

Remote commP calculation

• The commP calculation can now be delegated to the AP nodes in the sealing pipeline.

HTTP Retrievals

• Boost HTTP endpoint can now be discovered publicly via the boost client.
• SP's can set their HTTP url that will be shared as part of this new libp2p endpoint

HTTP online deals

• Boost can now limit the number of simultaneous HTTP connections when downloading the deal data. Check all about the HTTP limiter here. This applies to both libp2p-http (Estuary) and HTTP (Bidbot and boost client) storage deals.
• The UI Transfer page now displays all the ongoing HTTP connections and their transfer speed.
• A new config version is available with new HTTP rate limiting parameters
• The amount of space that can be reserved for downloaded data per-host is now configurable. This helps mitigate against a single host with a slow connection reserving all the download space, when there may be other hosts with faster connections that have not had a chance to propose a deal yet

General

• Dagstore can be queried to find the piece CID for a given payload CID
  • boostd dagstore lookup-piece-cid --help
• Boost client will now return the sector state from sealing pipeline instead of just "sealing" when querying the deal status
• Boost will now allow using a single wallet for deal collaterals as well as deal message publishing

What's Changed

• When migrating from lotus start from default config by @dirkmc in #702
• publish message menu bar-chart by @dirkmc in #703
• deal publishing / fees: remove redundant configs by @nonsense in #687
• send sealing status in deal status response by @dirkmc in #704
• Calculate commp on sealing node by @dirkmc in #541
• v1.4.0-rc1 release by @LexLuthr in #719
• booster-http: don't extract contents of CAR file for HEAD requests by @dirkmc in #718
• libp2p retrieval transports endpoint by @dirkmc in #723
• booster-http: disable on-the-fly indexing by default by @dirkmc in #646
• set booster-http cache control headers by @dirkmc in #724
• Fix Content-Length header in HEAD request for CAR file by @dirkmc in #725
• Rename booster-http flag --api-sealer to --api-storage by @dirkmc in #734
• Update config version to 3 by @LexLuthr in #735
• Transfer limiter by @dirkmc in #710
• Docker files by @airenas in #713
• fix: dagstore destroy-shard by @LexLuthr in #744
• consolidate markdown documentation by @nonsense in #743
• change network name for devnet by @nonsense in #747
• Transfer limiter web UI updates by @dirkmc in #740
• feat: dagstore lookup-cid command by @LexLuthr in #751
• bump version for v1.4.0-rc2 by @LexLuthr in #755
• chore: fix version-check.sh perms by @LexLuthr in #758
• monitoring docker stack by @nonsense in #760
• Throttle local commp by @dirkmc in #763
• FIx dockerfile for building react by @airenas in #764
• tracing for boost and booster-http by @nonsense in #738
• Allow Boost RPC API to capture parent trace contexts by @kylehuntsman in #771
• Add --enable-tracing flag to booster-http by @kylehuntsman in #776
• Output sealing state changes to the deal log by @dirkmc in #775
• Fail the deal if the transfer fails by @dirkmc in #777
• tracing behind feature-flag for boostd; configuration in config.toml by @nonsense in #778
• Docker boost speedup by @airenas in #770
• Configurable download limit per host by @dirkmc in #780
• fix log line by @nonsense in #783
• README: fix port for gui by @nonsense in #789
• Remove single wallet restriction by @LexLuthr in #792
• Speed up tests with transfers by @dirkmc in #799
• Set up initial infrastructure for Grafana metrics capture with docker monitoring stack by @kylehuntsman in #797
• Add react GUI to boost docker by @airenas in #793
• feat: add json output to boostd pieces command by @LexLuthr in #806
• bump version to v1.4.0 by @LexLuthr in #808

New Contributors

• @airenas made their first contribution in #713
• @kylehuntsman made their first contribution in #771

Full Changelog: v1.3.1...v1.4.0

v1.4.0-rc2

Overview

We're happy to announce Boost v1.4.0-rc2 release, with multiple changes and improvements!
Please make sure to upgrade to test the new features shipped in this release. See our upgrade guide for details.

Please review the Boost and Lotus compatibility matrix to plan your upgrade.

Highlights

• Boost HTTP endpoint can now be discovered publicly via the boost client.
  • SP's can set their HTTP url that will be shared as part of this new libp2p endpoint
• Boost can now limit the number of simultaneous HTTP connections when downloading the deal data. Check all about the HTTP limiter here. This applies to both libp2p-http (Estuary) and HTTP (Bidbot and boost client) storage deals.
• The UI Transfer page now displays all the ongoing HTTP connections and their transfer speed.
• Dagstore can be queried to find the piece CID for a given payload CID
  • boostd dagstore lookup-piece-cid --help
• A new config version is available with new HTTP rate limiting parameters

What's Changed

• booster-http: don't extract contents of CAR file for HEAD requests by @dirkmc in #718
• libp2p retrieval transports endpoint by @dirkmc in #723
• booster-http: disable on-the-fly indexing by default by @dirkmc in #646
• set booster-http cache control headers by @dirkmc in #724
• Fix Content-Length header in HEAD request for CAR file by @dirkmc in #725
• Rename booster-http flag --api-sealer to --api-storage by @dirkmc in #734
• Update config version to 3 by @LexLuthr in #735
• Transfer limiter by @dirkmc in #710
• Docker files by @airenas in #713
• fix: dagstore destroy-shard by @LexLuthr in #744
• consolidate markdown documentation by @nonsense in #743
• change network name for devnet by @nonsense in #747
• Transfer limiter web UI updates by @dirkmc in #740
• feat: dagstore lookup-cid command by @LexLuthr in #751
• bump version for v1.4.0-rc2 by @LexLuthr in #755

New Contributors

• @airenas made their first contribution in #713

Full Changelog: v1.4.0-rc1...v1.4.0-rc2

v1.4.0-rc1

Overview

We're happy to announce Boost v1.4.0-rc1 release, with multiple changes and improvements!

Highlights

• The commP calculation can now be delegated to the AP nodes in the sealing pipeline.
• Boost client will now return the sector state from sealing pipeline instead of just "sealing" when querying the deal status

What's Changed

• When migrating from lotus start from default config by @dirkmc in #702
• publish message menu bar-chart by @dirkmc in #703
• deal publishing / fees: remove redundant configs by @nonsense in #687
• send sealing status in deal status response by @dirkmc in #704
• Calculate commp on sealing node by @dirkmc in #541
• v1.4.0-rc1 release by @LexLuthr in #719

Full Changelog: v1.3.1...v1.4.0-rc1

v1.3.1

Overview

We're happy to announce Boost v1.3.1 release, with multiple changes and improvements!
This release includes important fixes, some of which may be critical for security. Unless the fix addresses a bug being exploited in the wild, the fix will not be called out in the release notes.

Highlights

• Fix for 'database is locked error'
• Fix for crash in boost client deal status command

What's Changed

• chore: update xcode version to supported by @LexLuthr in #694
• Fix 'database is locked' error by @nonsense in #679
• fix nil ptr in deal status command by @nonsense in #685
• chore: add dependabot.yml file by @jacobheun in #653
• chore(deps): bump terser from 5.13.1 to 5.14.2 in /react by @dependabot in #658
• fix settings page file size preview by @dirkmc in #701

Full Changelog: v1.3.0...v1.3.1