From e0c1246f0fe076addbf78915f1a3f30d3cf31d32 Mon Sep 17 00:00:00 2001 From: Lingwei Gu Date: Sun, 16 Jan 2022 15:00:36 -0500 Subject: [PATCH 1/5] Update sample_slurm_script.sh --- docs/reproduction/sample_slurm_script.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/reproduction/sample_slurm_script.sh b/docs/reproduction/sample_slurm_script.sh index 4caea75c..d02fc86b 100644 --- a/docs/reproduction/sample_slurm_script.sh +++ b/docs/reproduction/sample_slurm_script.sh @@ -12,7 +12,7 @@ # Modify the following lines according to your setup process -module load arch/avx512 StdEnv/2018.3 java/11 python/3.7 scipy-stack +module load arch/avx512 StdEnv/2020 java/11 python/3.7 scipy-stack ENVDIR=$HOME/venv/capreolus-env source $ENVDIR/bin/activate From dad2b39cc48e6b9c4c91b02f1dc2a65fb2b60b26 Mon Sep 17 00:00:00 2001 From: Lingwei Gu Date: Sun, 16 Jan 2022 15:04:06 -0500 Subject: [PATCH 2/5] Update MS_MARCO.md --- docs/reproduction/MS_MARCO.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/reproduction/MS_MARCO.md b/docs/reproduction/MS_MARCO.md index 1df7cf76..0b12b399 100644 --- a/docs/reproduction/MS_MARCO.md +++ b/docs/reproduction/MS_MARCO.md @@ -51,4 +51,5 @@ To adapt it to the `mini` version, simply change the GPU number and request time + Results (with hypperparameter-0) replicated by [@crystina-z](https://github.com/crystina-z) on 2020-12-06 (commit [`6c3759f`](https://github.com/crystina-z/capreolus-1/commit/6c3759fe620f18f8939670176a18c744752bc9240)) (Tesla V100 on Compute Canada) + Results (with hypperparameter-6) replicated by [@Dahlia-Chehata](https://github.com/Dahlia-Chehata) on 2021-03-29 (commit [`7915aad`](https://github.com/capreolus-ir/capreolus/commit/7915aad75406527a3b88498926cff85259808696)) (Tesla V100 on Compute Canada) + Results (with hypperparameter-7) replicated by [@larryli1999](https://github.com/larryli1999) on 2021-05-16 (commit [`6d1aed2`](https://github.com/capreolus-ir/capreolus/commit/6d1aed29de7828ceb94560a8bf7c87f1af5458b5)) (Tesla V100 on Compute Canada) -+ Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada) \ No newline at end of file ++ Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada) ++ Results (MRR@10=0.333) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-16 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) From d9092979b47fd3d423cd6a6f97d6cb651e888699 Mon Sep 17 00:00:00 2001 From: Lingwei Gu Date: Sun, 16 Jan 2022 15:04:31 -0500 Subject: [PATCH 3/5] Update MS_MARCO.md --- docs/reproduction/MS_MARCO.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/reproduction/MS_MARCO.md b/docs/reproduction/MS_MARCO.md index 0b12b399..b2afc3d8 100644 --- a/docs/reproduction/MS_MARCO.md +++ b/docs/reproduction/MS_MARCO.md @@ -52,4 +52,4 @@ To adapt it to the `mini` version, simply change the GPU number and request time + Results (with hypperparameter-6) replicated by [@Dahlia-Chehata](https://github.com/Dahlia-Chehata) on 2021-03-29 (commit [`7915aad`](https://github.com/capreolus-ir/capreolus/commit/7915aad75406527a3b88498926cff85259808696)) (Tesla V100 on Compute Canada) + Results (with hypperparameter-7) replicated by [@larryli1999](https://github.com/larryli1999) on 2021-05-16 (commit [`6d1aed2`](https://github.com/capreolus-ir/capreolus/commit/6d1aed29de7828ceb94560a8bf7c87f1af5458b5)) (Tesla V100 on Compute Canada) + Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada) -+ Results (MRR@10=0.333) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-16 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) ++ Results (MRR@10=0.333) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-16 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) (Tesla V100 on Compute Canada) From 27089ec88937d8d4d4c11b2ae1c03f128c4cff94 Mon Sep 17 00:00:00 2001 From: Lingwei Gu Date: Fri, 21 Jan 2022 23:24:10 -0500 Subject: [PATCH 4/5] Update MS_MARCO.md --- docs/reproduction/MS_MARCO.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/reproduction/MS_MARCO.md b/docs/reproduction/MS_MARCO.md index b2afc3d8..6ba5d09b 100644 --- a/docs/reproduction/MS_MARCO.md +++ b/docs/reproduction/MS_MARCO.md @@ -52,4 +52,4 @@ To adapt it to the `mini` version, simply change the GPU number and request time + Results (with hypperparameter-6) replicated by [@Dahlia-Chehata](https://github.com/Dahlia-Chehata) on 2021-03-29 (commit [`7915aad`](https://github.com/capreolus-ir/capreolus/commit/7915aad75406527a3b88498926cff85259808696)) (Tesla V100 on Compute Canada) + Results (with hypperparameter-7) replicated by [@larryli1999](https://github.com/larryli1999) on 2021-05-16 (commit [`6d1aed2`](https://github.com/capreolus-ir/capreolus/commit/6d1aed29de7828ceb94560a8bf7c87f1af5458b5)) (Tesla V100 on Compute Canada) + Results (MRR@10=0.356) replicated by [@andrewyguo](https://github.com/andrewyguo) on 2021-05-29 (commit [`1ce71d9`](https://github.com/capreolus-ir/capreolus/commit/1ce71d93ab5473b40d4ae02768fd053261b27320)) (Tesla V100 on Compute Canada) -+ Results (MRR@10=0.333) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-16 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) (Tesla V100 on Compute Canada) ++ Results (MRR@10=0.356) reproduced by [@lingwei-gu](https://github.com/lingwei-gu) on 2022-01-20 (commit [`1bbf0f2`](https://github.com/capreolus-ir/capreolus/commit/1bbf0f295b09774e2fb2a1db7dfddef88adec7be)) (Tesla V100 on Compute Canada) From 0520f90a816f6454e1dbd44fc3b887fd102b7d99 Mon Sep 17 00:00:00 2001 From: Lingwei Gu Date: Fri, 21 Jan 2022 23:25:36 -0500 Subject: [PATCH 5/5] Update config_msmarco.txt --- docs/reproduction/config_msmarco.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/reproduction/config_msmarco.txt b/docs/reproduction/config_msmarco.txt index 1e47af96..b050f350 100644 --- a/docs/reproduction/config_msmarco.txt +++ b/docs/reproduction/config_msmarco.txt @@ -23,3 +23,4 @@ reranker.trainer.decayiters=1 reranker.trainer.decaytype=linear reranker.trainer.loss=pairwise_hinge_loss +reranker.trainer.decay=0.1