Skip to content

merklescience/ms-zilliqa-etl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Zilliqa ETL CLI

Build Status

Zilliqa ETL CLI lets you convert Zilliqa data into JSON newline-delimited format.

Full documentation available here.

Quickstart

Install Zilliqa ETL CLI:

pip3 install zilliqa-etl

Export directory service blocks (Schema, Reference):

> zilliqaetl export_ds_blocks --start-block 1 --end-block 500000 \
--output-dir output --provider-uri https://api.zilliqa.com

Find other commands here.

For the latest version, check out the repo and call

> pip3 install -e . 
> python3 zilliqaetl.py

Useful Links

Running Tests

> pip3 install -e .[dev]
> export ZILLIQAETL_PROVIDER_URI=https://api.zilliqa.com
> pytest -vv

Running Tox Tests

> pip3 install tox
> tox

Running in Docker

  1. Install Docker https://docs.docker.com/install/

  2. Build a docker image(bump version on every release)

     > docker build --platform linux/x86_64 -t  us.gcr.io/staging-btc-etl/merklescience/zilliqa-etl:0.0.7 .
     > docker image ls
    
  3. Run a container out of the image

     > docker run -v $HOME/output:/zilliqa-etl/output zilliqa-etl:latest export_ds_blocks -s 1 -e 500000 -o output
    
  4. Push the image to container registry.

     > docker push us.gcr.io/staging-btc-etl/merklescience/zilliqa-etl:0.0.7