You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
a PIE dataset builder in dataset_builders/pie/DATASET_NAME with
a PIE dataset loading script DATASET_NAME.pyor a config DATASET_NAME.yaml in the case of BRAT based datasets, and
a dataset card in a README.md file
a HF dataset builder, if not yet publicly available (except on https://huggingface.co/DFKI-SLT), in dataset_builders/hf/DATASET_NAME with
a HF dataset loading script DATASET_NAME.py (NOTE: this should be copied from the location mentioned at BASE_DATASET_PATH of the PIE dataset builder!), and
a dataset card in a README.md file. Note: this should be directly put next to the HF script, e.g. at https://huggingface.co/DFKI-SLT
the readmes and PIE builder scripts / configs should be in dataset_builders/pie/DATASET_NAME; the tests in tests/dataset_builder/pie/test_DATASET_NAME.py
this may require to implement new (generic) conversion or processing code as in https://github.com/ArneBinder/pie-document-level. For any of that, there should also be tests in the respective locations under tests.
The text was updated successfully, but these errors were encountered:
This is an overview issue, please create PRs for the following datasets:
aae2
dataset #64 and addaae2
dataset - v.2 #92abstrct
dataset #68argmicro
#56sciarg
dataset #61For each dataset, there should be:
dataset_builders/pie/DATASET_NAME
withDATASET_NAME.py
or a configDATASET_NAME.yaml
in the case of BRAT based datasets, andREADME.md
filedataset_builders/hf/DATASET_NAME
witha HF dataset loading scriptDATASET_NAME.py
(NOTE: this should be copied from the location mentioned atBASE_DATASET_PATH
of the PIE dataset builder!), andREADME.md
file. Note: this should be directly put next to the HF script, e.g. at https://huggingface.co/DFKI-SLTNotes:
dataset_builders/pie/DATASET_NAME
; the tests intests/dataset_builder/pie/test_DATASET_NAME.py
tests
.The text was updated successfully, but these errors were encountered: