Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Historic state directory size is 10 times more space rather than non historic blockchain data #1485

Open
oleksandrSydorenkoJ opened this issue Mar 31, 2023 · 3 comments
Assignees
Labels
enhancement New feature or request epic:archive-node

Comments

@oleksandrSydorenkoJ
Copy link

Describe the bug
The archive node contains 2 extra directories - historic_state and historic_root, allowing get historical data from the blockchain.
The mainnet difference between historic and non-historic states is 4 times (8TB for archive and 2TB for geth)

Versions:
skalenetwork/schain:3.16.0-stable.3-historic

Preconditions:
Active Skale chain with connected archival node
The skale chain should have at least 4 million blocks and 10-12 million transactions with contract interaction (ERC20, ERC721 etc)

To Reproduce

  1. Run archive node to connected schain
  2. Wait for the archive node already syncing
  3. Check the size of the databases in skaled data_dir

Expected behavior
Historic_state data-dir should be 4 times bigger rather than non-historic data as it represented on Ethereum

Actual state
Historic state directory size is 10 times more space rather non-historic blockchain data

Example data-dirs size:

5.0G	blocks_and_extrass + state
1.5G	consensus blocks_N.db
0	filestorage
49M	historic_roots
74G	historic_state

@DmytroNazarenko
Copy link
Collaborator

@kladkogex Check and try to optimize space usage of historic state

@DmytroNazarenko
Copy link
Collaborator

Out of release 2.2 scope because it is not so critical

@DmytroNazarenko DmytroNazarenko moved this from Ready For Pickup to To Do in SKALE Engineering 🚀 Jun 7, 2023
@DmytroNazarenko DmytroNazarenko added this to the SKALE 2.3 milestone Jul 4, 2023
@DmytroNazarenko DmytroNazarenko added enhancement New feature or request and removed bug Something isn't working labels Jul 5, 2023
@DmytroNazarenko DmytroNazarenko removed this from the SKALE 2.3 milestone Aug 3, 2023
@oleksandrSydorenkoJ
Copy link
Author

actual for 3.19.3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request epic:archive-node
Projects
None yet
Development

No branches or pull requests

3 participants