Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fine-tuning Script #1

Open
BoPeng112 opened this issue May 17, 2023 · 1 comment
Open

Fine-tuning Script #1

BoPeng112 opened this issue May 17, 2023 · 1 comment

Comments

@BoPeng112
Copy link

Thanks for sharing this interesting work. I was wondering if you are going to share the scripts for fine-tuning LLMs.

@zyuanat
Copy link
Contributor

zyuanat commented May 27, 2023

Thank you for your attention and sorry for the late reply.

We have released the code and script for training and testing.
Take the End2end MoRec for text recommendation (Bert-base + SASRec) as an example, you can run 'cd bce_text/main-end2end', then 'python train_bert_base.py'.
The files looked like 'train_xxx.py' are the scripts, you can change the parameters in these files, the details maybe need to be adjusted based on your GPU resources and Python environment.

It is worth noting that "LLMs" usually refer to models with comparable parameters to GPT-3, much larger than the Bert and Roberta used in our paper. Due to the GPU limitation and the challenges of fine-tuning, LLMs are not considered in our paper. How to apply End2end LLMs to Recsys is a valuable research direction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants