diff --git a/docs/reproduction/MS_MARCO.md b/docs/reproduction/MS_MARCO.md index 1df7cf76..6ba5d09b 100644 --- a/docs/reproduction/MS_MARCO.md +++ b/docs/reproduction/MS_MARCO.md @@ -51,4 +51,5 @@ To adapt it to the `mini` version, simply change the GPU number and request time + Results (with hypperparameter-0) replicated by [@crystina-z](https://github.com/crystina-z) on 2020-12-06 (commit [`6c3759f`](https://github.com/crystina-z/capreolus-1/commit/6c3759fe620f18f8939670176a18c744752bc9240)) (Tesla V100 on Compute Canada) + Results (with hypperparameter-6) replicated by [@Dahlia-Chehata](https://github.com/Dahlia-Chehata) on 2021-03-29 (commit [`7915aad`](https://github.com/capreolus-ir/capreolus/commit/7915aad75406527a3b88498926cff85259808696)) (Tesla V100 on Compute Canada) + Results (with hypperparameter-7) replicated by [@larryli1999](https://github.com/larryli1999) on 2021-05-16 (commit [`6d1aed2`](https://github.com/capreolus-ir/capreolus/commit/6d1aed29de7828ceb94560a8bf7c87f1af5458b5)) (Tesla V100 on Compute Canada) -+ Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada) \ No newline at end of file ++ Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada) ++ Results (MRR@10=0.356) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-20 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) (Tesla V100 on Compute Canada) diff --git a/docs/reproduction/config_msmarco.txt b/docs/reproduction/config_msmarco.txt index 1e47af96..b050f350 100644 --- a/docs/reproduction/config_msmarco.txt +++ b/docs/reproduction/config_msmarco.txt @@ -23,3 +23,4 @@ reranker.trainer.decayiters=1 reranker.trainer.decaytype=linear reranker.trainer.loss=pairwise_hinge_loss +reranker.trainer.decay=0.1 diff --git a/docs/reproduction/sample_slurm_script.sh b/docs/reproduction/sample_slurm_script.sh index 4caea75c..d02fc86b 100644 --- a/docs/reproduction/sample_slurm_script.sh +++ b/docs/reproduction/sample_slurm_script.sh @@ -12,7 +12,7 @@ # Modify the following lines according to your setup process -module load arch/avx512 StdEnv/2018.3 java/11 python/3.7 scipy-stack +module load arch/avx512 StdEnv/2020 java/11 python/3.7 scipy-stack ENVDIR=$HOME/venv/capreolus-env source $ENVDIR/bin/activate