Skip to content

Research Intern Project @ MBZUAI. Multilingual Multi-task Statement Tuning of Encoder Models for Zero-Shot Task Generalization. Won UGRIP 2024 Best Team.

Notifications You must be signed in to change notification settings

sophiayk20/UGRIP_MST

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

68 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

UGRIP_MST

Multilingual Statement Tuning

Running Evaluation Script

python evalscript.py --model ashabrawy/ST-roberta-base --tokenizer roberta-base

Datasets, Trained Models Repo in HuggingFace

https://huggingface.co/mbzuai-ugrip-statement-tuning

Running the Training Script

python3 statement_tune.py --Exp_name "XLMR" --transformer "xlm-roberta-base" --save "./XLMR2" The Base statement to train the XLMR model on english dataset, can add hyperparameter flags as needed. Supported flags: --tol --test_size --tr_ep --tr_batch --ev_batch --warmup --lr --decay

About

Research Intern Project @ MBZUAI. Multilingual Multi-task Statement Tuning of Encoder Models for Zero-Shot Task Generalization. Won UGRIP 2024 Best Team.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages