This code is the implementation for DMBERT model. The implementations are based on Huggingface's Transformers, especially its example for the multiple-choice task.
-
python==3.6.9
-
torch==1.2.0
-
transformers==2.8.0
-
sklearn==0.20.2
Hint: please read and delete all the comments after \
in each line of the .sh
scripts before running them.
- Download MAVEN data files.
- Run
run_MAVEN.sh
for training and evaluation on the devlopment set. - Run
run_MAVEN_infer.sh
to get predictions on the test set (dumped toresults.jsonl
).
See the two scripts for more details.
- Preprocess ACE 2005 dataset as in this repo.
- Run
run_ACE.sh
for training and evaluation.