Releases: filecoin-project/boost
v2.4.0
Overview
We're excited to introduce Boost v2.4.0. This release enables the Filecoin Network upgrade to NV24 for Boost.
Please refer to Curio documentation and getting started guide for Curio <> Boost configuration.
Compatibility
This release is compatible with Lotus versions v1.30.0. For the latest compatibility details, refer to the Boost compatibility matrix.
What's Changed
- chore: switch to Github Actions by @LexLuthr in #1933
- feat(gocql): add authentication support by @strahe in #1939
- fix: sector accessor auth URL handling for ipv6 by @LexLuthr in #1950
- fix directDealAllocate missing
automatic yes
by @beck-8 in #1953 - fix: remove sectorBlocks package from Boost by @LexLuthr in #1955
- fix: boost allocate commands by @strahe in #1957
- chore(deps): bump serve-static and express in /react by @dependabot in #1963
- chore(deps): bump webpack from 5.76.1 to 5.94.0 in /react by @dependabot in #1958
- chore(deps): bump micromatch from 4.0.5 to 4.0.8 in /react by @dependabot in #1959
- chore(deps): bump rollup from 2.74.1 to 2.79.2 in /react by @dependabot in #1968
- feat: add support for creating allocations via EVM contract by @kacperzuk-neti in #1970
- feat: add curio stats by @LexLuthr in #1969
- fix: check provider for ddo deals by @LexLuthr in #1973
- release v2.4.0-rc1 by @LexLuthr in #1972
- chore(deps): bump cookie and express in /react by @dependabot in #1974
- chore(deps): bump http-proxy-middleware from 2.0.6 to 2.0.7 in /react by @dependabot in #1976
- chore: release v2.4.0 by @LexLuthr in #1980
New Contributors
- @strahe made their first contribution in #1939
- @kacperzuk-neti made their first contribution in #1970
Full Changelog: v2.3.0...v2.4.0
v2.4.0-rc1
Overview
We're excited to introduce Boost v2.4.0-rc1. This release enables the Filecoin Network upgrade to NV24 for Boost.
Please refer to Curio documentation and getting started guide for Curio <> Boost configuration.
Compatibility
This release is compatible with Lotus versions v1.30.0-rc2. For the latest compatibility details, refer to the Boost compatibility matrix.
⚠️ Golang version
Boost v2.4.0-rc1 required Golang version v1.22.3 or higher.
What's Changed
- chore: switch to Github Actions by @LexLuthr in #1933
- feat(gocql): add authentication support by @strahe in #1939
- fix: sector accessor auth URL handling for ipv6 by @LexLuthr in #1950
- fix directDealAllocate missing
automatic yes
by @beck-8 in #1953 - fix: remove sectorBlocks package from Boost by @LexLuthr in #1955
- fix: boost allocate commands by @strahe in #1957
- chore(deps): bump serve-static and express in /react by @dependabot in #1963
- chore(deps): bump webpack from 5.76.1 to 5.94.0 in /react by @dependabot in #1958
- chore(deps): bump micromatch from 4.0.5 to 4.0.8 in /react by @dependabot in #1959
- chore(deps): bump rollup from 2.74.1 to 2.79.2 in /react by @dependabot in #1968
- feat: add support for creating allocations via EVM contract by @kacperzuk-neti in #1970
- feat: add curio stats by @LexLuthr in #1969
- fix: check provider for ddo deals by @LexLuthr in #1973
- release v2.4.0-rc1 by @LexLuthr in #1972
New Contributors
- @strahe made their first contribution in #1939
- @kacperzuk-neti made their first contribution in #1970
Full Changelog: v2.3.0...v2.4.0-rc1
v2.3.0
Overview
We're excited to introduce Boost v2.3.0. This release enable the Filecoin Network upgrade to NV23(🧇) for Boost.
It also focuses on compatibility with Curio.
Please refer to Curio documentation and getting started guide for Curio <> Boost configuration.
Compatibility
This release is compatible with Lotus versions v1.28.1. For the latest compatibility details, refer to the Boost compatibility matrix.
⚠️ Golang version
Boost v2.3.0 required Golang version v1.22.3 or higher.
What's Changed
- chore(deps): bump github.com/filecoin-project/lotus from 1.26.1 to 1.26.2 by @dependabot in #1911
- chore(deps): bump github.com/filecoin-project/lotus from 1.26.2 to 1.26.3 by @dependabot in #1913
- chore: refactor allocate command by @LexLuthr in #1912
- fix: add debug logs for pdcleaner by @LexLuthr in #1910
- chore(deps): bump ejs from 3.1.8 to 3.1.10 in /react by @dependabot in #1915
- fix: reject deals longer than sector lifetime by @LexLuthr in #1916
- chore: bump pubsub version by @LexLuthr in #1917
- fix: close empty libp2p streams by @LexLuthr in #1920
- feat: make Boost compliant with Lotus v1.27.0 by @LexLuthr in #1919
- feat: make Boost curio compliant by @LexLuthr in #1918
- chore(deps): bump braces from 3.0.2 to 3.0.3 in /react by @dependabot in #1924
- chore: release v2.3.0-rc2 by @LexLuthr in #1926
- Add nosync flag to init by @ZenGround0 in #1929
- fix: out of bounds access in
ListFlaggedPieces
by @jmg-duarte in #1927 - Fix panic when recovering broken sector. by @cryptowhizzard in #1921
- chore: fix some comments by @haouvw in #1935
- chore: update lotus dependency to v1.27.1 by @LexLuthr in #1936
- fix: single stream download for small files by @LexLuthr in #1931
- fix: boostd net commands by @LexLuthr in #1941
- chore: update lotus dependency to v1.28.1 by @LexLuthr in #1942
New Contributors
- @ZenGround0 made their first contribution in #1929
- @jmg-duarte made their first contribution in #1927
- @haouvw made their first contribution in #1935
Full Changelog: v2.2.0...v2.3.0
v2.3.0-rc2
Overview
We're excited to introduce Boost v2.3.0-rc2. This release focuses on compatibility with Curio.
Please refer to Curio documentation and getting started guide for Curio <> Boost configuration.
Compatibility
This release is compatible with Lotus versions v1.27.0. For the latest compatibility details, refer to the Boost compatibility matrix.
⚠️ Golang version
Boost v2.3.0-rc2 required Golang version v1.22.3 or higher.
What's Changed
- feat: make Boost curio compliant by @LexLuthr in #1918
- chore(deps): bump braces from 3.0.2 to 3.0.3 in /react by @dependabot in #1924
- chore: release v2.3.0-rc2 by @LexLuthr in #1926
Full Changelog: v2.3.0-rc1...v2.3.0-rc2
v2.3.0-rc1
Overview
We're excited to introduce Boost v2.3.0-rc1. This release focuses on compatibility with Lotus v1.27.0 and some minor bug fixes.
Compatibility
This release is compatible with Lotus versions v1.27.0. For the latest compatibility details, refer to the Boost and Lotus compatibility matrix.
⚠️ Golang version
Boost v2.3.0-rc1 required Golang version v1.21.7 or higher.
What's Changed
- chore(deps): bump github.com/filecoin-project/lotus from 1.26.1 to 1.26.2 by @dependabot in #1911
- chore(deps): bump github.com/filecoin-project/lotus from 1.26.2 to 1.26.3 by @dependabot in #1913
- chore: refactor allocate command by @LexLuthr in #1912
- fix: add debug logs for pdcleaner by @LexLuthr in #1910
- chore(deps): bump ejs from 3.1.8 to 3.1.10 in /react by @dependabot in #1915
- fix: reject deals longer than sector lifetime by @LexLuthr in #1916
- chore: bump pubsub version by @LexLuthr in #1917
- fix: close empty libp2p streams by @LexLuthr in #1920
- feat: make Boost compliant with Lotus v1.27.0 by @LexLuthr in #1919
Full Changelog: v2.2.0...v2.3.0-rc1
v2.2.0
Overview
We're excited to introduce Boost v2.2.0. This release enables Direct Data Onboarding (DDO) for Boost.
Compatibility
This release is compatible with Lotus versions v1.26.0 and v1.26.1. For the latest compatibility details, refer to the Boost and Lotus compatibility matrix.
⬆️ Upgrade
The upgrade guide/tutorial for upgrading to v2.2.0 can be found in the Boost documentation.
⚠️ Golang version
Boost v2.2.0 required Golang version v1.21.7 or higher.
👉 ⚠️ ❗ ❗ Warning: This release has breaking changes to configuration structure ❗ ❗
- Please save you current configuration to a file with
boostd config updated --diff
and note down your pricing configuration from UI. - Start
boostd
after upgrade and shutdown after a successful start - Review the
<boost repo>/config.toml
for configuration parameters saved in step 1 and update them if they have been reset to default values. You should also restore your pricing configuration back from UI.
⚠️ ❗ ❗ Aggregate proving must be enabled in Lotus Miner for verified DDO deals to work properly❗ ❗
⭐ Highlights
DDO integration
- Boost now support onboarding verified direct deals.
boostd import-direct --help
NAME:
boostd import-direct - Import data for direct onboarding flow with Boost
USAGE:
boostd import-direct [command options] <piececid> <file>
OPTIONS:
--delete-after-import whether to delete the data for the import after the data has been added to a sector (default: false)
--client-addr value
--allocation-id value (default: 0)
--remove-unsealed-copy (default: false)
--skip-ipni-announce indicates that deal index should not be announced to the IPNI(Network Indexer) (default: false)
--start-epoch value start epoch by when the deal should be proved by provider on-chain (default: 2 days from now) (default: 0)
--help, -h show help
- Boost UI has a new deals page for direct deals.
- The Boost client now offers extended functionality for handling data caps. Users can leverage the boostd client to create new data cap allocations, in addition to viewing a list of existing allocations. This streamlines the process of managing storage quotas for your direct deals.
LID clean up
- A new process now runs every 6 hours to automatically clean up old deals from the LID. It reduces the storage footprint of the LID, improving overall performance and efficiency.
By removing unnecessary data, the LID becomes more streamlined and easier to manage. - Deals that have been completed or have been penalized for violating storage commitments are no longer stored in the LID. Deals associated with the legacy system are removed once completed. Direct deals that have reached their maximum term are purged from the LID.
- The cleanup process also removes any orphaned deals from the LID. These are deals that don't have a corresponding entry in the SQL database but are still attributed to a particular miner.
🗄️ Curio compatibility
This Boost release will be fully compatible with upcoming Curio release. Curio is the new improved Lotus-miner alternative with a distributed scheduling. You can read more about Curio here.
🏗️ Improvements
- Users can advertise new deals and removal of old deals manually to IPNI.
- Boost no longer uses
go-fil-markets
repo as a dependency. All the code for handling legacy deals had been purged from Boost. - Fixed a bug that resulted in an unexpected "End of File" (EOF) error during the parsing of segments for PODSI deals.
- Boost client can be used to extend the existing verified claims for old and new verified deal.
- Boost UI page is updated to show all the relevant information for DDO deals.
- Some minor fixes to improve the DDO deal workflow in Boost.
What's Changed
- fix: remove on-the-fly indexing by @LexLuthr in #1875
- fix: unexpected EOF when parsing segments for PODSI deals by @LexLuthr in #1874
- feat: add deal IPNI announce command by @LexLuthr in #1877
- feat: manual legacy deal IPNI announcement by @LexLuthr in #1879
- fix: remove boost-gfm and go-data-transfer by @LexLuthr in #1740
- fix: remove MakeBoostDeal test method by @LexLuthr in #1883
- integrate direct data onboarding (nv22) by @nonsense in #1847
- feat: LID clean up by @LexLuthr in #1881
- chore: release v2.2.0-rc1 by @LexLuthr in #1884
- chore: update devnet versions by @LexLuthr in #1885
- fix: refactor LID clean up by @LexLuthr in #1886
- fix: panic when no claim is found by @LexLuthr in #1888
- fix: allocate should not compare tmin and tmax with head by @LexLuthr in #1890
- fix: update DDO UI by @LexLuthr in #1889
- chore(deps): bump follow-redirects from 1.15.0 to 1.15.6 in /react by @dependabot in #1894
- chore(deps): bump github.com/filecoin-project/lotus from 1.26.0-rc1 to 1.26.0-rc3 by @dependabot in #1893
- feat: add claim-extend command by @LexLuthr in #1891
- fix: account for DDO in UI by @LexLuthr in #1892
- chore(deps): bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /react by @dependabot in #1896
- chore: bump lotus to v1.26.0 by @LexLuthr in #1898
- chore(deps): bump express from 4.18.1 to 4.19.2 in /react by @dependabot in #1899
- chore: bump lotus to v1.26.1 by @LexLuthr in #1904
- fix: enable on-the-fly-reindexing by @LexLuthr in #1903
- fix: extend-claim cli DC batching by @LexLuthr in #1900
- fix: handle not found errors in pdcleaner by @LexLuthr in #1905
- fix: lid recovery by @LexLuthr in #1906
- feat: GetAsk API by @LexLuthr in #1907
Full Changelog: v2.1.2...v2.2.0
v2.2.0-rc2
Overview
We're excited to introduce Boost v2.2.0-rc2. This release enables Direct Data Onboarding (DDO) for Boost.
Compatibility
This release is compatible with Lotus versions v1.26.0. For the latest compatibility details, refer to the Boost and Lotus compatibility matrix.
⬆️ Upgrade
The upgrade guide/tutorial for upgrading to v2.2.0-rc2 can be found in the Boost documentation.
⚠️ Golang version
Boost v2.2.0-rc2 required Golang version v1.21.7 or higher.
👉 ⚠️ ❗ ❗ Warning: This release has breaking changes to configuration structure ❗ ❗
- Please save you current configuration to a file with
boostd config update --diff
and note down your pricing configuration from UI. - Start
boostd
after upgrade and shutdown after a successful start - Review the
<boost repo>/config.toml
for configuration parameters saved in step 1 and update them if they have been reset to default values. You should also restore your pricing configuration back from UI.
⚠️ ❗ ❗ Aggregate proving must be enabled in Lotus Miner for verified DDO deals to work properly❗ ❗
🏗️ Improvements
- Boost client can be used to extend the existing verified claims for old and new verified deal.
- Boost UI page is updated to show all the relevant information for DDO deals.
- Some minor fixes to improve the DDO deal workflow in Boost.
What's Changed
- fix: panic when no claim is found by @LexLuthr in #1888
- fix: allocate should not compare tmin and tmax with head by @LexLuthr in #1890
- fix: update DDO UI by @LexLuthr in #1889
- chore(deps): bump follow-redirects from 1.15.0 to 1.15.6 in /react by @dependabot in #1894
- chore(deps): bump github.com/filecoin-project/lotus from 1.26.0-rc1 to 1.26.0-rc3 by @dependabot in #1893
- feat: add claim-extend command by @LexLuthr in #1891
- fix: account for DDO in UI by @LexLuthr in #1892
- chore(deps): bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /react by @dependabot in #1896
- chore: bump lotus to v1.26.0 by @LexLuthr in #1898
- chore(deps): bump express from 4.18.1 to 4.19.2 in /react by @dependabot in #1899
Full Changelog: v2.2.0-rc1...v2.2.0-rc2
v2.2.0-rc1
Overview
We're excited to introduce Boost v2.2.0-rc1. This release enables Direct Data Onboarding (DDO) for Boost.
Compatibility
This release is compatible with Lotus versions v1.26.0-rc1 and v1.26.0-rc2. For the latest compatibility details, refer to the Boost and Lotus compatibility matrix.
⬆️ Upgrade
The upgrade guide/tutorial for upgrading to v2.2.0-rc1 can be found in the Boost documentation.
⚠️ Golang version
Boost v2.2.0-rc1 required Golang version v1.21.7 or higher.
👉 ⚠️ ❗ ❗ Warning: This release has breaking changes to configuration structure ❗ ❗
- Please save you current configuration to a file with
boostd config update --diff
and note down your pricing configuration from UI. - Start
boostd
after upgrade and shutdown after a successful start - Review the
<boost repo>/config.toml
for configuration parameters saved in step 1 and update them if they have been reset to default values. You should also restore your pricing configuration back from UI.
⚠️ ❗ ❗ Aggregate proving must be enabled in Lotus Miner for verified DDO deals to work properly❗ ❗
⭐ Highlights
DDO integration
- Boost now support onboarding verified direct deals.
boostd import-direct --help
NAME:
boostd import-direct - Import data for direct onboarding flow with Boost
USAGE:
boostd import-direct [command options] <piececid> <file>
OPTIONS:
--delete-after-import whether to delete the data for the import after the data has been added to a sector (default: false)
--client-addr value
--allocation-id value (default: 0)
--remove-unsealed-copy (default: false)
--skip-ipni-announce indicates that deal index should not be announced to the IPNI(Network Indexer) (default: false)
--start-epoch value start epoch by when the deal should be proved by provider on-chain (default: 2 days from now) (default: 0)
--help, -h show help
- Boost UI has a new deals page for direct deals.
- The Boost client now offers extended functionality for handling data caps. Users can leverage the boostd client to create new data cap allocations, in addition to viewing a list of existing allocations. This streamlines the process of managing storage quotas for your direct deals.
LID clean up
- A new process now runs every 6 hours to automatically clean up old deals from the LID. It reduces the storage footprint of the LID, improving overall performance and efficiency.
By removing unnecessary data, the LID becomes more streamlined and easier to manage. - Deals that have been completed or have been penalized for violating storage commitments are no longer stored in the LID. Deals associated with the legacy system are removed once completed. Direct deals that have reached their maximum term are purged from the LID.
- The cleanup process also removes any orphaned deals from the LID. These are deals that don't have a corresponding entry in the SQL database but are still attributed to a particular miner.
🏗️ Improvements
- Users can advertise new deals and removal of old deals manually to IPNI.
- Boost no longer uses
go-fil-markets
repo as a dependency. All the code for handling legacy deals had been purged from Boost. - Fixed a bug that resulted in an unexpected "End of File" (EOF) error during the parsing of segments for PODSI deals.
- We've eliminated the practice of on-the-fly indexing for deals. This approach involved indexing deals whenever encountered through HTTP requests or Bitswap retrievals to reduce inefficiencies that could arise when dealing with unsealed sectors or inaccurate IPNI information.
What's Changed
- fix: remove on-the-fly indexing by @LexLuthr in #1875
- fix: unexpected EOF when parsing segments for PODSI deals by @LexLuthr in #1874
- feat: add deal IPNI announce command by @LexLuthr in #1877
- feat: manual legacy deal IPNI announcement by @LexLuthr in #1879
- fix: remove boost-gfm and go-data-transfer by @LexLuthr in #1740
- fix: remove MakeBoostDeal test method by @LexLuthr in #1883
- integrate direct data onboarding (nv22) by @nonsense in #1847
- feat: LID clean up by @LexLuthr in #1881
- chore: release v2.2.0-rc1 by @LexLuthr in #1884
- chore: update devnet versions by @LexLuthr in #1885
- fix: refactor LID clean up by @LexLuthr in #1886
Full Changelog: v2.1.2...v2.2.0-rc1
v2.1.2
Overview
We're excited to introduce Boost v2.1.2. This release focuses on reducing the resource usage utilisation for boostd-data
service.
This is a recommended release for everyone on Boost v2.x
Compatibility
This release is compatible with Lotus versions v1.24.0 and v1.25.0. For the latest compatibility details, refer to the Boost and Lotus compatibility matrix.
⭐ Highlights
- A new command to send a removal advertisement to IPNI. This can be used to clean up any old records from network indexers.
- Performance improvements in piece doctor.
- Piece doctor can now be disabled in configuration.
- UI enhancements for deal lifecycle and sector lifecycle separation.
What's Changed
- feat: data segment indexing by @LexLuthr in #1739
- Update deal list page by @LexLuthr in #1837
- fix: handle complete checkpoint in UI deal list by @LexLuthr in #1841
- fix: config to disable piece doctor by @LexLuthr in #1849
- Prefetch state claims to change O(n) calls to Lotus State to O(1) by @RobQuistNL in #1855
- Add sectorID index to deal table by @RobQuistNL in #1853
- add indexes to deals DB by @LexLuthr in #1857
- feat: cleanup older fund manager logs by @LexLuthr in #1856
- doc: fix flag info and error message for block serving by @rvagg in #1825
- feat: index ad removal command by @LexLuthr in #1859
- fix: UI deal error messages by @LexLuthr in #1863
- bump up cbor-gen utility by @nonsense in #1865
- safe handlers by @nonsense in #1866
- Upgrade dependencies by @masih in #1867
- fix: handle panic in podsi indexing by @ischasny in #1868
- fix: fallback to regular indexing if podsi failed by @ischasny in #1870
- chore: release v2.1.2 by @LexLuthr in #1871
Full Changelog: v2.1.1...v2.1.2
v2.1.1
Overview
We're excited to introduce Boost v2.1.1. This release focuses on reducing the resource usage utilisation for boostd-data
service.
Compatibility
This release is compatible with Lotus versions v1.24.0 and v1.25.0. For the latest compatibility details, refer to the Boost and Lotus compatibility matrix.
⚠️ Important Upgrade Notice
👉 Before updating, carefully read the release notes and documentation. Storage providers will need to set up a database service and undergo a database migration process. Incorrect procedures can lead to permanent data loss.
⭐ Highlights
- The high CPU usage by boostd-data service is now fixed
- Deal indexing has been improved to avoid deals getting stuck in "Announcing" state
- Boost UI should not display the momentary
searching message: %!w(<nil>)
message anymore
What's Changed
- fix: parametrise add index parallelism by @ischasny in #1827
- piece-directory: make sure we process recs correctly by @nonsense in #1828
- fix: set default add index concurrency to 8 by @ischasny in #1829
- skip flaky TestDealsRejectedForFunds test by @nonsense in #1830
- booster-http: add pprof-port flag by @nonsense in #1831
- fix: better formatting for error messages by @ischasny in #1833
- boostx: print warning instead of exiting on api mismatch by @nonsense in #1832
- chore: release v2.1.1 by @LexLuthr in #1835
Full Changelog: v2.1.0...v2.1.1